-- Logs begin at Mon 2022-09-12 11:15:12 UTC, end at Mon 2022-09-12 12:15:27 UTC. -- Sep 12 11:44:34.457006 dv-cinder-853315-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 11:44:34.465172 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 11:44:34 2022] *** Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: nodename: dv-cinder-853315-9-iscsi Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: machine: x86_64 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: clock source: unix Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: pcre jit disabled Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: detected number of CPU cores: 4 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: current working directory: / Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: detected binary path: /usr/bin/uwsgi-core Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: your processes number limit is 47680 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: your memory page size is 4096 bytes Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: detected max file descriptor number: 2048 Sep 12 11:44:34.468222 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: lock engine: pthread robust mutexes Sep 12 11:44:34.469057 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: thunder lock: enabled Sep 12 11:44:34.469057 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 11:44:34.469057 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 11:44:34.508022 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: Python main interpreter initialized at 0x55c21360d9c0 Sep 12 11:44:34.508022 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: python threads support enabled Sep 12 11:44:34.508022 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: your server socket listen backlog is limited to 100 connections Sep 12 11:44:34.508022 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: your mercy for graceful operations on workers is 90 seconds Sep 12 11:44:34.508432 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 11:44:34.508506 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: *** Operational MODE: preforking *** Sep 12 11:44:34.508711 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: *** uWSGI is running in multiple interpreter mode *** Sep 12 11:44:34.508711 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: spawned uWSGI master process (pid: 105365) Sep 12 11:44:34.508913 dv-cinder-853315-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 11:44:34.509944 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: spawned uWSGI worker 1 (pid: 105366, cores: 1) Sep 12 11:44:34.509944 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: spawned uWSGI worker 2 (pid: 105367, cores: 1) Sep 12 11:44:34.510117 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 11:44:35.173679 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 11:44:35.181209 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 11:44:36.262438 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:44:36.262438 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: from cryptography.utils import int_from_bytes Sep 12 11:44:36.263059 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:44:36.263059 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: from cryptography.utils import int_from_bytes Sep 12 11:44:36.263202 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:44:36.263202 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: from cryptography.utils import int_from_bytes Sep 12 11:44:36.263202 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:44:36.263202 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: from cryptography.utils import int_from_bytes Sep 12 11:44:38.744603 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 11:44:38.745184 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 11:44:38.745278 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 11:44:38.745630 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 11:44:38.745701 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 11:44:38.745768 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 11:44:38.745959 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 11:44:38.746056 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 11:44:38.746328 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 11:44:38.746473 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.746586 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 11:44:38.746673 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.746977 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747066 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747301 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747389 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747622 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747714 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.747928 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748027 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748252 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748339 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748560 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748652 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748880 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.748966 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749137 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749229 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749457 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749552 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749751 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.749841 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-9-iscsi {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750064 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750154 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750385 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750487 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-9-iscsi {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750725 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.750818 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751035 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751127 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751339 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751432 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751654 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751737 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.751956 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.752039 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.752271 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.752456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.752564 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.752902 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753063 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753218 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753374 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753531 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753681 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753869 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.753992 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.754186 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.754325 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.755048 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.755372 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.755477 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.755683 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.755789 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756007 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756092 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756318 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756444 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756645 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756732 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-9-iscsi {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.756959 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757051 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757349 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757446 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-9-iscsi {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757664 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757749 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.757980 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.758081 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.758295 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.758394 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.758703 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.758829 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759025 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759119 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759335 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759430 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759647 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759739 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.759975 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760060 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760285 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760375 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760601 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760686 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.760920 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761011 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761221 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761304 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761530 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761616 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761839 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.761930 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762151 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762253 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762576 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762790 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.762883 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763044 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763145 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763354 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763447 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763622 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763713 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.763931 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764033 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764254 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764339 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764542 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764626 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764796 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.764885 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765118 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765204 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765370 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765688 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.765781 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766006 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766092 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766316 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766650 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766751 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.766959 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767044 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767268 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767364 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767576 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767660 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767882 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.767966 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768189 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768286 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768500 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768595 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768819 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.768904 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769125 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769210 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769445 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769535 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769756 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.769849 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.770766 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.770872 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.770995 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771121 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771341 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771426 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771662 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771755 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.771976 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772061 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772298 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772398 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772621 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772711 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.772929 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773013 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773239 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773324 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773549 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773857 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.773947 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774169 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774267 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774491 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774647 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774768 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.774854 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775073 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775170 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775381 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775467 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775694 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775794 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.775987 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776086 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776293 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776384 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776600 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776684 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776900 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.776995 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777206 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777290 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777506 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777592 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777813 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.777904 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778119 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778202 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778424 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778600 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778760 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.778846 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779067 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779150 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779371 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779454 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779676 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779768 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.779982 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780068 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780290 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780376 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780596 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780682 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780903 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.780989 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781212 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781310 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781517 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781602 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781825 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.781908 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782216 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782440 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782563 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782785 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.782870 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783090 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783181 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783400 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783492 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783710 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.783794 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784013 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784097 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784322 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784414 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784628 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784718 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.784936 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785035 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785239 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785323 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785549 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785642 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.785937 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786035 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786301 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786392 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786653 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786742 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.786968 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787063 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787279 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787369 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787586 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787668 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787891 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.787984 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788195 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788291 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788499 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788583 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788800 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.788892 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789192 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789403 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789495 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789720 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.789814 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790027 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790111 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790337 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790422 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790664 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790761 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.790975 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.791067 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.791303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:44:38.791389 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.791639 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.791725 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.791961 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792052 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792299 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792398 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792613 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792704 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.792943 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793034 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793261 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793354 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793579 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793664 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793893 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.793991 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794208 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794300 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794538 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794630 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794857 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.794940 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795173 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795259 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795493 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795596 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795819 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.795928 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796136 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796239 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796458 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796560 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796777 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.796871 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797090 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797188 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797408 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797492 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797726 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.797819 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798051 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798142 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798367 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798453 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798710 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.798798 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799026 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799114 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799370 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799698 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.799783 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800016 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800114 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800329 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800451 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800646 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800738 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.800958 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801337 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801436 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801653 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801751 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.801997 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802131 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802315 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802459 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802656 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802807 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.802980 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803137 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803296 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803618 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803779 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.803933 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804097 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804247 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804414 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804563 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804730 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.804879 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805069 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805192 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805390 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805553 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805716 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.805815 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806036 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806142 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806354 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806452 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806705 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.806804 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807026 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807114 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807342 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807437 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807657 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807743 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.807967 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808052 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808276 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808406 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808580 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808666 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808887 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.808980 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809192 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809288 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809496 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809581 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809818 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.809903 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810130 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810222 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810438 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810545 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810796 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.810890 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811106 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811196 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811420 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811504 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811732 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.811815 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812037 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812122 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812341 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812435 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812652 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812743 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.812960 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813052 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813265 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813350 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813589 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813683 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813895 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.813986 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814201 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814292 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814541 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814641 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814844 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.814929 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815154 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815240 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815466 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815564 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815779 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.815864 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816091 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816175 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816406 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816500 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816716 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.816801 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.817621 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.817700 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.817941 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.818200 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.818285 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.818572 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.818662 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.818914 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819012 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819221 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819306 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819549 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819640 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819874 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.819967 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820191 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820275 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820494 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820578 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820804 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.820899 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821111 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821205 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821416 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821501 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821718 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.821810 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822028 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822112 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822331 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822418 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822661 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822750 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.822965 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823059 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823269 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823353 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823571 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823665 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823892 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.823977 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.824472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.824570 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.824786 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.824879 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825090 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825175 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825391 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825488 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825731 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.825815 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826036 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826120 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826373 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826465 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826733 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.826820 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827053 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827149 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827375 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827468 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827688 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.827817 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828006 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828091 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828317 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828410 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828627 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828711 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.828938 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829022 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829250 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829342 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829571 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829655 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829885 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.829969 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830202 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830287 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830548 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830636 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830859 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.830945 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831169 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831255 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831489 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831575 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831793 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.831878 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.832109 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.832201 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.832445 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.832570 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.832822 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833046 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833149 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833393 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833479 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833724 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.833809 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834045 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834132 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834355 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834440 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834697 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.834796 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835012 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835100 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835326 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835410 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835642 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835734 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.835951 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836045 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836263 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836356 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836575 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836659 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836884 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.836972 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837208 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837300 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837510 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837603 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837814 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.837894 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838124 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838208 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838442 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838587 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838801 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.838896 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839115 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839211 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839432 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839528 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839746 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.839837 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840054 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840139 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840366 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840461 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840677 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840762 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.840981 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841065 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841286 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841371 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841596 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841680 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841905 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.841996 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842215 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842301 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842548 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842687 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842854 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.842939 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843161 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843246 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843468 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843552 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843776 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.843862 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.844081 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.844166 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.844391 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.844475 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.844703 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845163 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845163 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845374 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845442 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845507 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845631 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845730 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.845937 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846033 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846257 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846386 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846568 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846673 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846898 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.846985 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847203 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847283 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847508 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847610 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847812 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.847893 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.848673 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.848773 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.848989 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849083 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849344 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849429 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849654 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849739 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.849974 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850061 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850296 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850381 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850635 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850743 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.850954 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851042 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851268 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851360 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851580 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851665 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851895 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.851980 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852208 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852297 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852519 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852603 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852828 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.852914 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853140 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853231 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853450 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853546 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853763 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.853848 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854071 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854155 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854385 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854477 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854722 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.854809 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855031 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855116 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855335 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855437 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855647 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855742 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.855968 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.856217 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.856535 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.856630 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.856858 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.856942 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857171 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857255 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857495 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857827 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.857920 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858246 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858476 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858594 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858818 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.858919 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859127 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859213 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859434 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859518 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859738 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.859830 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860041 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860132 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860349 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860434 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860656 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860743 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.860960 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861044 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861267 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861407 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861569 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861655 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861870 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.861954 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862174 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862266 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862475 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862580 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862804 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.862900 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.863106 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.863189 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.863409 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.863495 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.864325 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.864420 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.864720 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865029 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865115 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865364 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865448 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865681 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865765 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.865990 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866075 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866296 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866380 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866630 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866720 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.866979 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867067 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867288 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867372 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867626 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867719 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.867958 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868045 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868302 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868389 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868608 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868701 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.868915 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869002 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869241 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869327 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869547 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869645 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869851 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.869942 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870156 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870241 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870467 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870578 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870805 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.870902 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871112 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871241 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871425 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871510 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871736 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.871822 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872049 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872134 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872400 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872485 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872652 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872739 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.872963 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873048 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873266 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873352 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873583 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873675 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873892 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.873984 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874198 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874291 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874499 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874662 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874837 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.874924 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875151 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875238 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875456 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875540 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875766 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.875895 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876070 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876165 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876387 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876479 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876693 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876787 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.876997 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877081 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877301 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877386 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877610 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877709 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.877920 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878005 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878224 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878352 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878574 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878683 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878894 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.878986 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.879200 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.879286 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.879677 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.879779 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.879994 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880136 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880302 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880571 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880681 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880885 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.880972 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881205 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881327 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881527 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881625 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881833 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.881920 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882140 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882224 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882445 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882781 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.882868 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883087 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883173 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883394 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883480 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883696 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.883781 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884000 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884086 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884304 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884390 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884608 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884693 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884912 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.884996 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885226 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885313 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885537 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885629 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885844 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.885930 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886148 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886240 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886451 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886562 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886801 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.886895 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887115 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887208 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887445 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887538 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887771 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.887866 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888090 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888177 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888407 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888502 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888720 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.888815 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889032 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889117 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889346 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889430 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889652 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889747 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.889956 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890041 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890270 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890361 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890607 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890696 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.890913 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891012 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891219 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891304 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891529 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891616 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891845 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.891930 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892157 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892242 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892471 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892558 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892791 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.892876 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893112 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893196 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893415 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893502 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893729 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.893815 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894038 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894132 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894348 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894433 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894684 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.894773 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895026 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895133 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895344 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895477 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895661 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895797 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.895977 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896118 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896294 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896437 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896610 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896837 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.896942 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897070 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897220 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897382 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897534 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897696 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.897842 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898011 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898165 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898320 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898478 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898675 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898811 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.898991 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899125 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899302 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899434 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899615 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899749 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.899923 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900055 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900240 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900493 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900579 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900810 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.900972 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901128 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901288 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901444 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901606 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901760 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.901914 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902077 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902226 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902398 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902563 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902746 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.902889 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903055 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903210 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903473 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903568 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903789 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.903925 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904106 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904241 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904422 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904556 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904731 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.904873 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905039 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905188 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905353 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905494 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905681 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905808 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.905988 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906137 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906295 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906445 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906624 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906783 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.906950 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907093 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907258 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907419 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907583 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907727 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.907999 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.908092 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.908315 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.908458 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.908624 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.908773 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909039 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909135 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909353 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909486 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909669 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909803 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.909994 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.910121 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.910317 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.910451 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911213 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911341 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911487 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911673 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911803 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.911985 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912118 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912305 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912444 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912620 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912768 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.912950 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913081 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913279 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913400 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913593 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913707 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.913915 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914029 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914225 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914351 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914575 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914700 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.914905 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915023 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915230 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915437 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915556 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915761 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.915974 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916060 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916301 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916435 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916616 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916712 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.916942 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917029 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917271 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917356 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917580 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917673 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917883 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.917969 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918187 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918279 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918494 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918657 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918827 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.918945 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919140 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919225 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919447 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919540 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919759 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.919843 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920066 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920151 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920372 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920461 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920671 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920756 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.920978 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921064 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921389 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921607 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921699 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.921928 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922022 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922242 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922327 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922567 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922656 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922894 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.922990 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923209 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923302 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923517 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923603 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923823 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.923921 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924128 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924213 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924437 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924525 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924743 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.924838 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925071 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925156 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925391 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925476 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925716 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.925802 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.926024 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.926108 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.926991 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927091 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927299 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927396 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927634 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927730 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.927945 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928038 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928267 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928355 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928579 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928665 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928884 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.928970 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929189 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929276 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929501 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929587 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929807 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.929900 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930112 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930198 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930417 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930503 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930752 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.930856 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931058 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931146 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931368 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931452 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931670 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931801 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.931974 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932062 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932281 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932367 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932602 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932696 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932909 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.932994 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933216 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933308 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933523 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933610 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933829 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.933914 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934137 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934223 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934445 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934576 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934805 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.934891 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935120 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935205 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935445 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935531 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935756 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.935841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936073 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936158 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936389 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936475 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936707 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.936798 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937023 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937116 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937340 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937434 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937656 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937740 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.937966 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938058 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938280 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938364 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938617 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938715 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.938939 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.939104 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.939260 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.939502 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.939589 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.939832 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940127 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940222 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940455 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940540 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940770 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.940856 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941086 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941179 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941405 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941491 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941719 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.941810 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942108 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942201 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942422 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942586 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942762 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.942851 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943077 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943169 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943395 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943481 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943720 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.943813 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944042 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944127 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944367 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944453 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944688 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.944786 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945007 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945094 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945324 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945410 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945646 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945741 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.945966 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946053 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946284 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946370 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946628 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946717 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.946949 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947036 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947265 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947359 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947578 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947663 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947896 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.947982 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948211 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948304 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948524 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948610 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948840 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.948926 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.949156 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.949557 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.949742 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.949834 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950057 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950142 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950374 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950468 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950722 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.950810 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951041 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951127 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951364 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951683 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951776 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.951998 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.952089 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.952317 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.952518 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.952637 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.952840 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953160 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953264 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953479 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953566 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953804 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.953897 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954126 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954225 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954448 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954552 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954803 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.954887 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955112 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955210 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955420 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955507 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955735 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.955819 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956138 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956347 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956432 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956658 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956742 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.956966 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957061 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957272 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957366 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957645 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957814 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.957938 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.958239 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.958471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.958790 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.958878 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.959150 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.959248 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.959481 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.959693 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.959807 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960051 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960139 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960377 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960464 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960713 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.960800 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961026 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961117 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961334 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961421 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961652 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961739 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.961963 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962066 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962271 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962356 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962601 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962690 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.962920 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963018 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963233 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963320 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963537 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963621 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963842 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.963938 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964145 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964454 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964552 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964767 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.964861 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965069 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965154 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965375 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965459 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965686 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965771 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.965995 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966080 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966299 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966384 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966630 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966728 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.966937 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967024 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967242 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967326 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967544 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967629 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967848 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.967932 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968152 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968465 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968551 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968772 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.968863 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969084 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969183 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969392 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969481 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969707 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.969792 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970010 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970104 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970316 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970402 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970664 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970753 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.970986 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971087 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971291 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971376 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971599 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971728 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.971909 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972003 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972220 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972346 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972546 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972641 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.972863 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.973611 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.973747 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.973952 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974036 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974275 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974373 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974640 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974909 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.974996 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975255 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975341 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975565 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975651 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975873 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.975966 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976201 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976294 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976514 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976601 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976824 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.976940 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977135 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977311 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977449 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977538 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977761 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.977853 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978071 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978165 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978381 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978467 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978716 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.978803 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979029 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979127 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979338 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979430 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979648 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979740 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.979957 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980265 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980358 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980573 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980658 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980881 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.980967 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981194 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981280 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981504 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981591 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981816 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.981903 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982134 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982228 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982453 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982568 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982804 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.982891 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983116 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983204 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983429 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983528 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983741 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.983834 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984050 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984135 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984363 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984458 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984676 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984762 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.984979 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.985063 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.985302 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.985635 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.985727 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.985952 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.986051 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.986262 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.986357 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.986631 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.986953 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987039 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987280 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987366 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987604 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987697 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.987919 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.988004 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.988233 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.988327 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.988549 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.988635 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.989533 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.989628 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.989794 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.989885 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990121 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990208 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990440 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990542 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990779 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.990874 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991093 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991180 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991404 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991490 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991721 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.991817 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992043 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992137 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992354 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992440 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992660 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992753 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.992967 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993053 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993282 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993368 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993592 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993686 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993896 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.993981 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994200 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994292 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994502 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994599 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994882 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.994975 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995138 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995233 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995442 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995527 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995742 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.995828 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996048 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996147 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996351 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996437 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996651 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996737 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.996957 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997051 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997262 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997568 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997659 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997872 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.997977 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998177 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998271 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998479 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998601 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998813 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.998901 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999120 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999206 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999428 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999514 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999734 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:38.999828 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000063 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000148 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000389 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000474 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000702 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.000789 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001025 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001110 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001341 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001427 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001656 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001742 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.001967 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002052 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002292 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002386 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002627 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002716 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.002944 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003031 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003256 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003351 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003570 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003657 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003885 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.003972 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004197 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004291 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004551 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004623 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004877 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.004965 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005188 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005284 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005511 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005596 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005830 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.005918 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006156 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006244 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006463 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006597 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006802 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.006888 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007126 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007220 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007438 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007531 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007753 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.007839 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008065 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008151 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008378 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008463 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008691 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.008786 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009004 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009090 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009315 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009401 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009627 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009720 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.009942 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010030 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010261 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010356 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010595 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010696 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.010915 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011003 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011231 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011316 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011547 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011634 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011872 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.011964 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012200 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012285 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012516 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012603 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012855 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.012941 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013181 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013265 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013497 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013812 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.013898 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.014121 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.014216 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.014367 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 11:44:39.014476 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.014817 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.015141 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.015451 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:44:39.015698 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 11:44:39.169729 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO dbcounter [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Registered counter for database nova_api Sep 12 11:44:39.170357 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO dbcounter [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Registered counter for database nova_api Sep 12 11:44:39.193076 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_db.sqlalchemy.engines [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.195519 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.200280 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writer thread running {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.202197 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writer thread running {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.257496 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.context [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7eb38210-af3a-4045-a92c-aff35466c2af(cell1) {{(pid=105366) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 11:44:39.260385 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.context [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7eb38210-af3a-4045-a92c-aff35466c2af(cell1) {{(pid=105367) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 11:44:39.261299 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:44:39.261766 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:44:39.263342 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:44:39.264074 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:44:39.264219 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:44:39.264563 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:44:39.264670 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:44:39.266202 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:44:39.266545 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_concurrency.lockutils [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:44:39.266944 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:44:39.267382 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:44:39.268516 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO dbcounter [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Registered counter for database nova_cell0 Sep 12 11:44:39.269344 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:44:39.271979 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO dbcounter [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Registered counter for database nova_cell0 Sep 12 11:44:39.273130 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO dbcounter [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Registered counter for database nova_cell1 Sep 12 11:44:39.276037 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO dbcounter [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Registered counter for database nova_cell1 Sep 12 11:44:39.281101 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_db.sqlalchemy.engines [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.283216 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_db.sqlalchemy.engines [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.284983 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.287860 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.288357 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writer thread running {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.293065 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writer thread running {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.431800 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writer thread running {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.434130 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writer thread running {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.441544 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO dbcounter [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Registered counter for database nova_cell0 Sep 12 11:44:39.444288 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO dbcounter [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Registered counter for database nova_cell0 Sep 12 11:44:39.448486 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG oslo_db.sqlalchemy.engines [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.451028 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:44:39.453547 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writer thread running {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.455635 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writer thread running {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:44:39.850259 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: WARNING keystonemiddleware.auth_token [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:44:39.857707 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: WARNING keystonemiddleware.auth_token [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:44:39.858118 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: WARNING keystonemiddleware.auth_token [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:44:39.868731 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: WARNING keystonemiddleware.auth_token [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:44:40.242529 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: WARNING keystonemiddleware.auth_token [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:44:40.249465 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: WARNING keystonemiddleware.auth_token [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:44:40.257462 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c21360d9c0 pid: 105367 (default app) Sep 12 11:44:40.259661 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:44:40.261029 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001822 Sep 12 11:44:40.261459 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Sep 12 11:44:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:44:40.265105 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: WARNING keystonemiddleware.auth_token [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:44:40.272755 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: WARNING keystonemiddleware.auth_token [None req-ee255e14-6e65-4ea8-9337-c2cba950759b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:44:40.278905 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c21360d9c0 pid: 105366 (default app) Sep 12 11:46:01.846788 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:01.847792 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 12 11:46:01.848197 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:01.860970 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_api:SELECT=3 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:01.861824 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_cell0:SELECT=3 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:01.862870 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_cell1:SELECT=3 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:01.863673 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:02.741845 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-8c17cc6d-ec4e-4cad-9eaf-819340d94dd3 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:02.775052 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-8c17cc6d-ec4e-4cad-9eaf-819340d94dd3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920051 Sep 12 11:46:02.775795 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 12 11:46:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:05.387704 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:05.389226 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-5ce0ae34-26f8-4839-95fd-7e8a82071f63 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 12 11:46:05.389783 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:05.854246 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-a96411bc-5f99-4ddc-838a-6cc8a35affa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "disk": 1, "name": "cirros256"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:05.904856 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-a96411bc-5f99-4ddc-838a-6cc8a35affa8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.508591 Sep 12 11:46:05.905421 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:05.918862 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_api:SELECT=3 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:05.919719 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_cell0:SELECT=3 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:05.922342 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_cell1:SELECT=3 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:05.923102 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:06.128014 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-fc5c914b-7426-4da1-977d-f3ec0b2e6117 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:06.196132 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-fc5c914b-7426-4da1-977d-f3ec0b2e6117 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282286 Sep 12 11:46:06.196646 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 12 11:46:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:08.853802 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-a96411bc-5f99-4ddc-838a-6cc8a35affa8 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:08.855029 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-a96411bc-5f99-4ddc-838a-6cc8a35affa8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 12 11:46:08.855558 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:09.539679 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-0c21cbef-b8da-458c-8ab5-fb4ee19ad9a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:09.579820 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-0c21cbef-b8da-458c-8ab5-fb4ee19ad9a2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716920 Sep 12 11:46:09.580495 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:09.594087 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-32947919-ca60-4f0c-a93c-6673c8d602c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:09.635219 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-32947919-ca60-4f0c-a93c-6673c8d602c6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044894 Sep 12 11:46:09.636294 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 12 11:46:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:12.245497 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-0c21cbef-b8da-458c-8ab5-fb4ee19ad9a2 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:12.246644 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-0c21cbef-b8da-458c-8ab5-fb4ee19ad9a2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Sep 12 11:46:12.247056 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:12.672996 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-3cbdae13-5b62-421c-acef-71651eeb683d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:12.693959 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-3cbdae13-5b62-421c-acef-71651eeb683d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439149 Sep 12 11:46:12.694836 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:12.708070 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-4a88dd00-3c94-4efe-abf6-0b5c3c511a72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:12.735434 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-4a88dd00-3c94-4efe-abf6-0b5c3c511a72 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031383 Sep 12 11:46:12.735926 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 12 11:46:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:15.368550 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-3cbdae13-5b62-421c-acef-71651eeb683d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:15.369561 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-3cbdae13-5b62-421c-acef-71651eeb683d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 12 11:46:15.369964 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:15.782646 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-2ee003be-2cea-457c-94c2-e2f3ffc26308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "ram": 2048, "disk": 10, "swap": 0}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:15.808614 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-2ee003be-2cea-457c-94c2-e2f3ffc26308 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431372 Sep 12 11:46:15.809407 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:15.822152 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-7c62c144-70c4-450c-97c6-dde973fbf13f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:15.851094 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-7c62c144-70c4-450c-97c6-dde973fbf13f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033192 Sep 12 11:46:15.851845 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 12 11:46:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:46:18.548010 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-2ee003be-2cea-457c-94c2-e2f3ffc26308 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:18.549284 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-2ee003be-2cea-457c-94c2-e2f3ffc26308 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Sep 12 11:46:18.549784 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:18.963508 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:18.982882 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427069 Sep 12 11:46:18.983441 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:18.995392 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-ba2079f1-a546-46fd-a9e9-d8e9f03e68fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:19.019662 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-ba2079f1-a546-46fd-a9e9-d8e9f03e68fc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027897 Sep 12 11:46:19.020234 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 12 11:46:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:21.621123 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:21.622360 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Sep 12 11:46:21.622826 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:46:22.082882 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-d1866858-b532-4b21-919c-e9a722607d0a admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:22.108650 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-d1866858-b532-4b21-919c-e9a722607d0a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479627 Sep 12 11:46:22.109193 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 12 11:46:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:46:24.738956 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:24.739891 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-b3422b80-2ad3-4eb2-9258-15c3d7de74f6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 12 11:46:24.740296 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:25.149913 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-2e6b2177-62ab-4093-b868-0953b450502b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:25.171339 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-2e6b2177-62ab-4093-b868-0953b450502b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424862 Sep 12 11:46:25.171893 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:25.185504 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-7380288e-08a6-4406-8f5c-6fb78330a4a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:25.211716 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-7380288e-08a6-4406-8f5c-6fb78330a4a4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030628 Sep 12 11:46:25.212291 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 12 11:46:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:27.872449 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-2e6b2177-62ab-4093-b868-0953b450502b admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:27.873448 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-2e6b2177-62ab-4093-b868-0953b450502b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 12 11:46:27.873849 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:28.258664 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-792aafeb-70a8-413f-ad73-693b1e407bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:28.281194 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-792aafeb-70a8-413f-ad73-693b1e407bab admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400991 Sep 12 11:46:28.282096 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 11:46:28.295253 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-ec148162-0b89-4cd8-92a8-c9f43784b827 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:28.323507 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-ec148162-0b89-4cd8-92a8-c9f43784b827 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033019 Sep 12 11:46:28.324947 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 12 11:46:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:30.969320 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-792aafeb-70a8-413f-ad73-693b1e407bab admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:30.970334 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-792aafeb-70a8-413f-ad73-693b1e407bab admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 12 11:46:30.970774 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:31.413022 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-a163c544-3c59-4692-8686-8b15f57aa111 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3", "swap": 0}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:31.435835 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-a163c544-3c59-4692-8686-8b15f57aa111 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.458776 Sep 12 11:46:31.437037 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:31.450206 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-98907701-f76f-4b38-8b07-8b5f66fc2941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:31.480845 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-98907701-f76f-4b38-8b07-8b5f66fc2941 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035194 Sep 12 11:46:31.481415 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 12 11:46:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:46:34.077610 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-a163c544-3c59-4692-8686-8b15f57aa111 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:34.080257 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-a163c544-3c59-4692-8686-8b15f57aa111 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 12 11:46:34.085518 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:34.559671 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-29531bc7-8a8e-466c-9b6d-2a0a970c43e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "vcpus": 4, "id": "4", "swap": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:34.565850 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:34.582091 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-29531bc7-8a8e-466c-9b6d-2a0a970c43e5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489503 Sep 12 11:46:34.582927 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:34.594834 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-126a1ad6-60bc-420f-b53f-5e4e3762bda8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:34.619310 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-126a1ad6-60bc-420f-b53f-5e4e3762bda8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028061 Sep 12 11:46:34.620033 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 12 11:46:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:46:37.325272 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-29531bc7-8a8e-466c-9b6d-2a0a970c43e5 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:37.326621 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-29531bc7-8a8e-466c-9b6d-2a0a970c43e5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Sep 12 11:46:37.332297 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:37.832890 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:37.841212 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:37.856008 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.521793 Sep 12 11:46:37.857039 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 12 11:46:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:46:37.868754 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-9afb6910-06ff-4aa1-81f9-27afa1933a6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:46:37.894874 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-9afb6910-06ff-4aa1-81f9-27afa1933a6d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029713 Sep 12 11:46:37.895784 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 12 11:46:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:46:55.041163 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:55.042207 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 12 11:46:55.043150 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:46:55.053823 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:46:55.437782 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-5c7f982e-f126-4b45-8309-7487feb6ee07 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:55.455941 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-5c7f982e-f126-4b45-8309-7487feb6ee07 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406589 Sep 12 11:46:55.456477 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 12 11:46:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:46:56.754948 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:56.755943 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-17f5ccac-c1da-453f-a45b-68255189b4a7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 12 11:46:56.756332 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:57.280078 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-39bfb341-a369-4790-ab3d-77ac1b12f40b admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:57.285300 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.wsgi [None req-39bfb341-a369-4790-ab3d-77ac1b12f40b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-39bfb341-a369-4790-ab3d-77ac1b12f40b admin admin] Request method failure captured: Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept: application/json Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept-Encoding: gzip, deflate Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Connection: keep-alive Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Content-Length: 0 Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Host: 10.222.0.15 Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-Api-Version: compute 2.92 Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-System-Scope: None Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: User-Agent: python-novaclient Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Auth-Token: gAAAAABjHxww1auF1jEWLT74heFXpgsGSgzRNSSrfWW7Ldl2rpldS7ztBK26V7GoJ4FUwPHwycFv-e5t9JGJ2_jP-xEJCdTz8cmjOlr0V_0MvVFh0KE4VCnF1nkrE9WFALc215hNP9lNoveQMEeMFoaE5xwnyJLIw6m8YbOHdgbKYTGaIQz9BiQ Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Id: None Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Name: None Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Identity-Status: Confirmed Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Is-Admin-Project: True Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Id: default Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Name: Default Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Name: admin Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Role: admin,reader,member Sep 12 11:46:57.288581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Roles: admin,reader,member Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant: admin Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Name: admin Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User: admin Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Id: default Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Name: Default Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Name: admin Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: method: > Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: exception: Flavor 42 could not be found. Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: action_args: {'id': '42'} Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:46:57.290230 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:57.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.292471 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-39bfb341-a369-4790-ab3d-77ac1b12f40b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:46:57.293586 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-39bfb341-a369-4790-ab3d-77ac1b12f40b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397452 Sep 12 11:46:57.293586 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 12 11:46:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 11:46:57.299843 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-4bf7c15e-d683-4758-b49e-0a8dadbafa04 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:57.322453 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-4bf7c15e-d683-4758-b49e-0a8dadbafa04 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026165 Sep 12 11:46:57.323017 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:46:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:46:57.334322 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-ccc0f216-93db-4d3d-b6f4-3193845bb19c admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:57.356720 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-ccc0f216-93db-4d3d-b6f4-3193845bb19c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026858 Sep 12 11:46:57.357272 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:46:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:46:57.366447 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-14f3b09a-cea5-463b-9585-6fa4f40a8279 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:57.372063 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.wsgi [None req-14f3b09a-cea5-463b-9585-6fa4f40a8279 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-14f3b09a-cea5-463b-9585-6fa4f40a8279 admin admin] Request method failure captured: Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept: application/json Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept-Encoding: gzip, deflate Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Connection: keep-alive Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Content-Length: 0 Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Host: 10.222.0.15 Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-Api-Version: compute 2.92 Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-System-Scope: None Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: User-Agent: python-novaclient Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Auth-Token: gAAAAABjHxww1auF1jEWLT74heFXpgsGSgzRNSSrfWW7Ldl2rpldS7ztBK26V7GoJ4FUwPHwycFv-e5t9JGJ2_jP-xEJCdTz8cmjOlr0V_0MvVFh0KE4VCnF1nkrE9WFALc215hNP9lNoveQMEeMFoaE5xwnyJLIw6m8YbOHdgbKYTGaIQz9BiQ Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Id: None Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Name: None Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Identity-Status: Confirmed Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Is-Admin-Project: True Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Id: default Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Name: Default Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Name: admin Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Role: admin,reader,member Sep 12 11:46:57.375487 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Roles: admin,reader,member Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant: admin Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Name: admin Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User: admin Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Id: default Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Name: Default Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Name: admin Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: method: > Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: exception: Flavor 42 could not be found. Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: action_args: {'id': '42'} Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:46:57.376865 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:57.377672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:57.379054 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-14f3b09a-cea5-463b-9585-6fa4f40a8279 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:46:57.380343 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-14f3b09a-cea5-463b-9585-6fa4f40a8279 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014032 Sep 12 11:46:57.380343 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 12 11:46:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 11:46:58.596658 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-ccc0f216-93db-4d3d-b6f4-3193845bb19c admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:58.597688 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-ccc0f216-93db-4d3d-b6f4-3193845bb19c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 12 11:46:58.598086 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:46:59.127102 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-c4ca0b41-24ac-47a9-adab-7e1ecfac7ff9 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:59.132102 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.wsgi [None req-c4ca0b41-24ac-47a9-adab-7e1ecfac7ff9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-c4ca0b41-24ac-47a9-adab-7e1ecfac7ff9 admin admin] Request method failure captured: Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept: application/json Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept-Encoding: gzip, deflate Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Connection: keep-alive Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Content-Length: 0 Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Host: 10.222.0.15 Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-Api-Version: compute 2.92 Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-System-Scope: None Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: User-Agent: python-novaclient Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Auth-Token: gAAAAABjHxwyD_j9fRkAEvkI0VlGu0k4dk4o2Oboe39576XaLtTiaACzRh4knRRkfyCL9kCq_FDtDZs9R2mvao_UILb53ZvQFvyw8qwOkPC2A5Ec6d1k59sHZ-3zb0jJSNNuAt4b1FUxekq1uPDTvliQMy_JfOoj8forC99scWQk989DPjm5hPM Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Id: None Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Name: None Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Identity-Status: Confirmed Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Is-Admin-Project: True Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Id: default Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Name: Default Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Name: admin Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Role: admin,reader,member Sep 12 11:46:59.133585 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Roles: admin,reader,member Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant: admin Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Name: admin Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User: admin Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Id: default Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Name: Default Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Name: admin Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: method: > Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: exception: Flavor 84 could not be found. Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: action_args: {'id': '84'} Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:46:59.135060 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:59.135857 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.137348 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-c4ca0b41-24ac-47a9-adab-7e1ecfac7ff9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:46:59.138619 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-c4ca0b41-24ac-47a9-adab-7e1ecfac7ff9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.401011 Sep 12 11:46:59.138619 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 12 11:46:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 11:46:59.145083 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-c1d1ca59-4980-4b20-8365-d304576cdeac admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:59.160352 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-c1d1ca59-4980-4b20-8365-d304576cdeac admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018989 Sep 12 11:46:59.160893 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:46:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:46:59.170817 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-a78849d3-20ec-491c-9f45-a7ef9e70d354 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:59.185868 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-a78849d3-20ec-491c-9f45-a7ef9e70d354 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019310 Sep 12 11:46:59.186384 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:46:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:46:59.195899 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-48cbeba8-b5f7-4f69-bfbd-195729494eea admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:46:59.200960 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.wsgi [None req-48cbeba8-b5f7-4f69-bfbd-195729494eea admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-48cbeba8-b5f7-4f69-bfbd-195729494eea admin admin] Request method failure captured: Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept: application/json Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept-Encoding: gzip, deflate Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Connection: keep-alive Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Content-Length: 0 Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Host: 10.222.0.15 Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-Api-Version: compute 2.92 Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-System-Scope: None Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: User-Agent: python-novaclient Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Auth-Token: gAAAAABjHxwyD_j9fRkAEvkI0VlGu0k4dk4o2Oboe39576XaLtTiaACzRh4knRRkfyCL9kCq_FDtDZs9R2mvao_UILb53ZvQFvyw8qwOkPC2A5Ec6d1k59sHZ-3zb0jJSNNuAt4b1FUxekq1uPDTvliQMy_JfOoj8forC99scWQk989DPjm5hPM Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Id: None Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Name: None Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Identity-Status: Confirmed Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Is-Admin-Project: True Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Id: default Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Name: Default Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Name: admin Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Role: admin,reader,member Sep 12 11:46:59.202436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Roles: admin,reader,member Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant: admin Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Name: admin Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User: admin Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Id: default Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Name: Default Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Name: admin Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: method: > Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: exception: Flavor 84 could not be found. Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: action_args: {'id': '84'} Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:46:59.204102 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:59.205131 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:46:59.206472 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-48cbeba8-b5f7-4f69-bfbd-195729494eea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:46:59.207787 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-48cbeba8-b5f7-4f69-bfbd-195729494eea admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012521 Sep 12 11:46:59.207787 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 12 11:46:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 12 11:47:00.420651 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-a78849d3-20ec-491c-9f45-a7ef9e70d354 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:00.421645 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-a78849d3-20ec-491c-9f45-a7ef9e70d354 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 12 11:47:00.422031 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:47:00.938082 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-5669ce58-e774-4f06-ab8f-5bb3d3e17cdb admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:00.944060 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.wsgi [None req-5669ce58-e774-4f06-ab8f-5bb3d3e17cdb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-5669ce58-e774-4f06-ab8f-5bb3d3e17cdb admin admin] Request method failure captured: Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept: application/json Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Accept-Encoding: gzip, deflate Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Connection: keep-alive Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Content-Length: 0 Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Host: 10.222.0.15 Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-Api-Version: compute 2.92 Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Openstack-System-Scope: None Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: User-Agent: python-novaclient Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Auth-Token: gAAAAABjHxw0_NFhDvfXgpKWiO3PVdcGhuFF0dr0rPLdD9PyejdA4Vbme0yWoo2mRvkG0gwOUC4otWEQ0GaWGXGoRrUGZF3rY48-vDZzOexYKQcj06ekwelXjtozGL9f6NJv0lZTfCcLZilL4VJ7w_n4kA8e7cUCfuSZdvDX8xqx26pZaMB5Fds Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Id: None Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Domain-Name: None Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Identity-Status: Confirmed Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Is-Admin-Project: True Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Id: default Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Domain-Name: Default Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Project-Name: admin Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Role: admin,reader,member Sep 12 11:47:00.945841 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Roles: admin,reader,member Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant: admin Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-Tenant-Name: admin Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User: admin Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Id: default Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Domain-Name: Default Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: X-User-Name: admin Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: method: > Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: exception: Flavor 451 could not be found. Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: action_args: {'id': '451'} Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:47:00.947454 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:47:00.948412 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: ERROR nova.api.openstack.wsgi Sep 12 11:47:00.949635 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-5669ce58-e774-4f06-ab8f-5bb3d3e17cdb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:47:00.950948 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-5669ce58-e774-4f06-ab8f-5bb3d3e17cdb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.386752 Sep 12 11:47:00.950948 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:47:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 11:47:00.957229 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-1f6d52e7-b89e-42b8-b202-3a23964315ed admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:00.971820 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-1f6d52e7-b89e-42b8-b202-3a23964315ed admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018218 Sep 12 11:47:00.972335 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:47:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:47:00.982154 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:00.997436 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019468 Sep 12 11:47:00.997964 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 12 11:47:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:47:01.007037 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-d46731de-16db-4752-be30-a4447f86c0e9 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:01.011923 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.wsgi [None req-d46731de-16db-4752-be30-a4447f86c0e9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-d46731de-16db-4752-be30-a4447f86c0e9 admin admin] Request method failure captured: Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept: application/json Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Accept-Encoding: gzip, deflate Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Connection: keep-alive Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Content-Length: 0 Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Host: 10.222.0.15 Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-Api-Version: compute 2.92 Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Openstack-System-Scope: None Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: User-Agent: python-novaclient Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Auth-Token: gAAAAABjHxw0_NFhDvfXgpKWiO3PVdcGhuFF0dr0rPLdD9PyejdA4Vbme0yWoo2mRvkG0gwOUC4otWEQ0GaWGXGoRrUGZF3rY48-vDZzOexYKQcj06ekwelXjtozGL9f6NJv0lZTfCcLZilL4VJ7w_n4kA8e7cUCfuSZdvDX8xqx26pZaMB5Fds Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Id: None Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Domain-Name: None Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Identity-Status: Confirmed Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Is-Admin-Project: True Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Id: default Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Domain-Name: Default Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Project-Name: admin Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Role: admin,reader,member Sep 12 11:47:01.013534 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Roles: admin,reader,member Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1375001928324c1f9d2a4c3ccf24704e"}]}] Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant: admin Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Id: 1375001928324c1f9d2a4c3ccf24704e Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-Tenant-Name: admin Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User: admin Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Id: default Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Domain-Name: Default Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Id: d0a0e6dd3f1445518b190cea2b73f55b Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: X-User-Name: admin Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: method: > Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: exception: Flavor 451 could not be found. Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: action_args: {'id': '451'} Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:47:01.015149 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:47:01.016043 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: ERROR nova.api.openstack.wsgi Sep 12 11:47:01.017237 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-d46731de-16db-4752-be30-a4447f86c0e9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:47:01.018570 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-d46731de-16db-4752-be30-a4447f86c0e9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011375 Sep 12 11:47:01.018570 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:47:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 12 11:47:02.256816 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:02.257825 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 12 11:47:02.258228 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:47:02.782651 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-ae6f793c-7e15-4bd4-9f79-a738adc3fa2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:47:02.801555 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-ae6f793c-7e15-4bd4-9f79-a738adc3fa2a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404071 Sep 12 11:47:02.802089 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 12 11:47:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:47:04.014566 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:04.015581 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 12 11:47:04.015986 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:47:04.543942 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-2c62b909-2f66-4263-b720-e38a4da9d542 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:47:04.562486 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-2c62b909-2f66-4263-b720-e38a4da9d542 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408108 Sep 12 11:47:04.563065 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 12 11:47:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:47:05.783394 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:05.784394 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 12 11:47:05.784795 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:47:06.307090 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-13ce7014-f373-461d-9173-e0d2c06a76e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:47:06.326178 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-13ce7014-f373-461d-9173-e0d2c06a76e2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404307 Sep 12 11:47:06.326749 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 12 11:47:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:47:07.564684 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:07.565687 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 12 11:47:07.566085 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:47:08.085783 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-9b77f135-58a4-4bab-82fb-69d11c1905f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:47:08.104480 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-9b77f135-58a4-4bab-82fb-69d11c1905f0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401047 Sep 12 11:47:08.105034 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 12 11:47:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 11:47:09.319176 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:09.320470 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 12 11:47:09.320864 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:47:09.844905 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-30e5ff27-19bc-477e-9fd7-13f4a9b2a4e4 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:47:09.864968 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-30e5ff27-19bc-477e-9fd7-13f4a9b2a4e4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405763 Sep 12 11:47:09.865509 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Sep 12 11:47:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:48:06.994041 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:06.995106 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-d8943bac-def7-4fe5-b47e-68f6384cd8b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 12 11:48:06.995509 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 12 11:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:48:07.006316 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:48:07.392924 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-d4b21f0d-8f03-463c-a41a-2bc27d589428 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:07.413771 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-d4b21f0d-8f03-463c-a41a-2bc27d589428 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411799 Sep 12 11:48:07.414327 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 12 11:48:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:48:07.435017 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_api:SELECT=14 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:48:07.438756 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-9ee47911-17e6-45c2-9303-cc7263e19ef3 admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:07.446123 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-9ee47911-17e6-45c2-9303-cc7263e19ef3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012629 Sep 12 11:48:07.446696 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Sep 12 11:48:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:48:07.459251 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-99f1b0c6-062d-4431-a617-5fbeac6efeb9 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:07.467162 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-99f1b0c6-062d-4431-a617-5fbeac6efeb9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011547 Sep 12 11:48:07.467674 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Sep 12 11:48:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:48:07.478978 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:07.486091 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010698 Sep 12 11:48:07.486727 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Sep 12 11:48:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:48:07.498636 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-b3d6a208-278d-4f5e-af82-e878709f2814 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:48:07.505680 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-b3d6a208-278d-4f5e-af82-e878709f2814 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010895 Sep 12 11:48:07.506196 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Sep 12 11:48:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:51:03.395550 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:03.396565 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 12 11:51:03.396963 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:51:03.537257 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_api:SELECT=6 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:51:03.701639 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:03.706269 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:03.706775 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:03.707196 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:03.707893 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:03.708331 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:03.708738 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:03.740191 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-15bccd39-3ca3-43f9-9569-1d00e58171aa admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204181 Sep 12 11:51:03.740737 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:51:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:51:04.825773 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:04.827336 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Sep 12 11:51:04.827734 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:51:05.019052 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:05.022488 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:05.023011 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:05.023437 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:05.024139 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:05.024578 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:05.024985 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:05.046729 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-70e62cf7-d24e-475b-8813-798f7a6d9a33 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080295 Sep 12 11:51:05.047328 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:51:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:51:16.536479 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:16.537547 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 12 11:51:16.537946 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:51:16.680792 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_cell0:SELECT=4 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:51:16.681514 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_cell1:SELECT=4 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:51:16.682287 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG dbcounter [-] [105367] Writing DB stats nova_api:SELECT=8 {{(pid=105367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:51:16.730376 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:16.733972 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:16.734447 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:16.734921 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:16.735615 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:16.736058 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:16.736477 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:16.761631 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-ff8db4b1-d751-4fb3-b760-ca8c341cda5f admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085200 Sep 12 11:51:16.762107 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:51:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:51:17.831773 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG nova.api.openstack.wsgi [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] Calling method '>' {{(pid=105366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:17.832779 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: INFO nova.api.openstack.requestlog [None req-0a974c1c-16dc-4fee-a18d-44f4cc05ed9d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 12 11:51:17.833181 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: [pid: 105366|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 12 11:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:51:18.021672 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG nova.api.openstack.wsgi [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Calling method '>' {{(pid=105367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:51:18.025117 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:18.025588 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:18.026037 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:18.026763 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:51:18.027198 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:51:18.027604 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: DEBUG oslo_concurrency.lockutils [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:51:18.048592 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: INFO nova.api.openstack.requestlog [None req-a212a4c9-692f-4129-b0a2-cc907a2ae604 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077892 Sep 12 11:51:18.049354 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: [pid: 105367|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 12 11:51:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:52:15.439442 dv-cinder-853315-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 12 11:52:15.440095 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: Mon Sep 12 11:52:15 2022 - graceful shutdown triggered... Sep 12 11:52:15.440527 dv-cinder-853315-9-iscsi devstack@n-api.service[105367]: Gracefully killing worker 2 (pid: 105367)... Sep 12 11:52:15.440876 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: Gracefully killing worker 1 (pid: 105366)... Sep 12 11:52:15.567433 dv-cinder-853315-9-iscsi devstack@n-api.service[105366]: DEBUG dbcounter [-] [105366] Writing DB stats nova_api:SELECT=4 {{(pid=105366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:52:16.440873 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: worker 1 buried after 1 seconds Sep 12 11:52:16.441400 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: worker 2 buried after 1 seconds Sep 12 11:52:16.441400 dv-cinder-853315-9-iscsi devstack@n-api.service[105365]: goodbye to uWSGI. Sep 12 11:52:16.442388 dv-cinder-853315-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 12 11:52:16.442987 dv-cinder-853315-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 12 11:52:16.445759 dv-cinder-853315-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 11:52:16.457232 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 11:52:16 2022] *** Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: nodename: dv-cinder-853315-9-iscsi Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: machine: x86_64 Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: clock source: unix Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: pcre jit disabled Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: detected number of CPU cores: 4 Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: current working directory: / Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: detected binary path: /usr/bin/uwsgi-core Sep 12 11:52:16.459286 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: your processes number limit is 47680 Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: your memory page size is 4096 bytes Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: detected max file descriptor number: 2048 Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: lock engine: pthread robust mutexes Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: thunder lock: enabled Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 11:52:16.460184 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: Python main interpreter initialized at 0x5578f7ee09c0 Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: python threads support enabled Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: your server socket listen backlog is limited to 100 connections Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: your mercy for graceful operations on workers is 90 seconds Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: *** Operational MODE: preforking *** Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: *** uWSGI is running in multiple interpreter mode *** Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: spawned uWSGI master process (pid: 120401) Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: spawned uWSGI worker 1 (pid: 120424, cores: 1) Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: spawned uWSGI worker 2 (pid: 120425, cores: 1) Sep 12 11:52:16.502618 dv-cinder-853315-9-iscsi devstack@n-api.service[120401]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 11:52:16.500725 dv-cinder-853315-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 11:52:17.174133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 11:52:17.176094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 11:52:18.343151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:52:18.343151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: from cryptography.utils import int_from_bytes Sep 12 11:52:18.343766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:52:18.343766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: from cryptography.utils import int_from_bytes Sep 12 11:52:18.344120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:52:18.344120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Sep 12 11:52:18.344554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 11:52:18.344554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Sep 12 11:52:20.784242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 11:52:20.784894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 11:52:20.784993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 11:52:20.785313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 11:52:20.785573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 11:52:20.785960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.786285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.786631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.786958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.787288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.787600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.787920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.788242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.788574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.788836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.789150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.789621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-9-iscsi {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.789946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.790255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.790594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.790916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.791234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.791557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.791875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.792530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.794696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 11:52:20.795121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.795260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 11:52:20.795366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.795447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.795525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 11:52:20.795793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.795909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 11:52:20.796116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 11:52:20.796239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.796438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.796652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.796883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.797982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.798415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.798415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.798880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-9-iscsi {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.799094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.799312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.799548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.799756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.799973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.800193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.800401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.800633 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.800820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-9-iscsi {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.801864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.802835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.803764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804737 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.804888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.805810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.806026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.806447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.806640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.807231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.807409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.807573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.807729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.807873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.808081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.808240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.808240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.808695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-9-iscsi {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.808864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.809950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.810971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811420 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.811905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.812942 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813239 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.813853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.814926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.815872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.816068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.816235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.816600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.816765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.817412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.817693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.817853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.818840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.819965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820568 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.820868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.821924 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.822890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.823040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.823443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.823588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.823841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.824955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.825870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.826014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.826216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.826371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.826767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.826924 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.827548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.827737 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.827969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828716 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.828867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.829988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.830951 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.831995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.832936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833087 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.833885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.834870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.835939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.836160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.836321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.836481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.836651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.837020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.837528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.837868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.838116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.838290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.838443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.838639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.838794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.838794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.839099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.839244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.840067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.840222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.840377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.840521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.840676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.840840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.840994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.841147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.841292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.841458 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.841623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.841776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.841927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.842070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.842214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.842368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.842669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.842832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.842996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.843149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.843302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.843470 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.843615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.843757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.843909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.844067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.844211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.844364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.844514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.844657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.844800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.844954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.845097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.845250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.845394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.845552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.845704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.845854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 11:52:20.846035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.846197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.846404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.846667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.847080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.847263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.847655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.847824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.848249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.848422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.848571 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.848723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.848882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.849948 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.850899 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851198 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.851932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.852966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.853868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.854990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.855643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.855803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.855960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.856939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.857322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.857474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.857858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.858026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.858460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.858644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.858791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.858955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.859871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.860913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.861971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.862895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863326 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.863914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.864940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.865985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.866976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.867136 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.867511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.867665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.868039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.868191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.868623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.868795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.868795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869533 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.869962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.870105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.870256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.870415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.870687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.870867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.871867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.872940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873569 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.873874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874321 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.874785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.875967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.876913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.877064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.877227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.877630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.877798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.878188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.878350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.878834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.878990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.878990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.879273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.879431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.879584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.879728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.879880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880336 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.880931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.881993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.882944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.883857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.884902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.885876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.886996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.887145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.887302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.887455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.887834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.887991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.888369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.888523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.888697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889399 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.889853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.890942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891087 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.891826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.892959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.893890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.894877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.897315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.897315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.897598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.897758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.898109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.898485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.898662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.898810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899616 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.899887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.900954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.901092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.901223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.901352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.901491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.901621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.902309 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.902459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.902630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.902774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.902914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.903856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904473 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.904877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905402 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.905928 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.906891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907333 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.907865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.908224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.908700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.908839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.908986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.909917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.910998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.911920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.912957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.913878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.914975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.915763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916289 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.916800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917611 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.917893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.918102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.918102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.918791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.918946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.918946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.919899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.920946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.921999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922956 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.922956 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.923863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.924943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.925895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.926909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.927882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.928012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.928150 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.928475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.928475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.928952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.929988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930128 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.930824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.931955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.932886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.933587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.933587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.933941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.934863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935528 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.935803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.936875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.937976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.938105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.938105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.938348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.938698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.938698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.939275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.939414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.939546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.939948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.939948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.940879 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.941925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.942636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.942636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.942902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.943707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.944980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.945903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.946619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.947853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.948368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.948502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.948502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.949460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.949597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.949750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.949987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.949987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.950450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.950600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.950733 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.950885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.950885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.951944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.952875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.953939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.954948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.955573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.955717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.955855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956571 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956860 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.956860 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.957999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.958245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.958376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.958587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.958722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.958882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.959480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.959619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.959759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.959901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.960120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.960277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.960589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.960728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.960869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.961990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.962986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.963948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.964941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.965863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.966925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967338 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967478 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.967930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.968892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.969041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.969588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.969737 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.969871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.970888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.971905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972848 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.972848 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.973890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974034 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974478 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.974947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.975923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.976901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.977179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.977377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.977515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.977705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.977897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.978923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.979096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.979248 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.979748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.980400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.980602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.980832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.980963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981076 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.981973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.982937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.983967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.984117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.984232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.984564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.984999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.985337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.985499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.985686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.985853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.985989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.986954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.987084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.987272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.987403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.987744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.987906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.988986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.989946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991128 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.991845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.992801 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.993859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994365 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.994870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.995051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.995278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.995436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.996156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.996313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.996510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.996844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997150 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.997742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.998960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.999147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.999796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:20.999796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.000286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.000516 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.000685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.000902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.000902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.001301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.001455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.001455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.001766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.001912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002506 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.002735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003321 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003473 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.003885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.004044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.004211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.004473 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.004634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.004878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.005870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.006993 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.007138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.007295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.007441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.007584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.007728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.008069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.008228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.008512 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.008675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.008822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.009008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.009231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.009569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.009901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.010304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.010468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.010645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.010791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.011026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.011563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.011726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.011892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012789 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.012951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.013867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.014848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.015992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016762 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.016987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017326 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.017960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018274 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.018924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.019987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.020925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.021908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.022882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023720 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.023811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024131 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024696 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.024878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.025023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.025330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.025430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.025639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.025944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.026109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.026257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.026487 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.026673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.027017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.027168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.027491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.027803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.027969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.028125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.028410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.028562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.028708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.028977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.029138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.029285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.029508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.029668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.029893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.030219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.030613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.030613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.030902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.031871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.032903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.033986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.034139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.034475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.034741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.034897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.035035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.035130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.035374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.035586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.035695 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.036961 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.037276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.037466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.037581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.037889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.038028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.038202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.038537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.038644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.038847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.039079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.039182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.039489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.039588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.039798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.040105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.040260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.040430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.040604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.040748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.041064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.041165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.041377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.041607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.041702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.042003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.042093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.042842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.043145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.043359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.043653 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.043747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.043979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.044140 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.044295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.044613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.044706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.044929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.045121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.045229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.045546 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.045646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.045873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.046096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.046216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.046499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.046627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.046904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.047090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.047185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.047507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.047607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.047821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.048092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.048186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.048486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.048587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.048803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.049051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.049150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.049412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.049548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.049654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 11:52:21.050035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.050540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.051041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.051531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.052041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.052533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.053167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.053665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.054169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.054762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.055267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.055761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.056287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.056849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.057275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.058775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.058775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.059093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.059634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.060204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.060700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.060908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.062047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.062564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.062656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.063148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.063890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.064395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.064395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.064889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.065450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.065885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.066284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.066555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.066880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.067203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.067523 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.067843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.068164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.068481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.068796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.069111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.069428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.069745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.070061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.070383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.070756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.071084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.071409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.071740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.072066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.072385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.072702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.073017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.073757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.073966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.074386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.074744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.075061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.075497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.075816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.076144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.076474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.076788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.077119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.077450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.077785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.078205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.078558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.078899 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.079242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.079579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.079912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.080226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.080537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.080916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.081165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.084907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.085793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.086656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.086656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.086879 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.087147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.087458 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.087771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.088084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.088422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.088767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.089091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.089625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.090006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.090344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.090690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.091028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.091363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.091697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.092014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.092358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.092679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.092998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.093316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.093636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.093953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.094269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.094628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.094967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.095282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.095616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.095940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.096264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.096584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.096903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.097237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.097553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.097869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.098184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.098499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.098834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.099154 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.099469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.099785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.100106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.100427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.100758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.101091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.101406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.101749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.102081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.102434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.102773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.103123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.103457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.103782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.104100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.104413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 11:52:21.104661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 11:52:21.112002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Registered counter for database nova_api Sep 12 11:52:21.133335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.139997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.168999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Registered counter for database nova_api Sep 12 11:52:21.190026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.196630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.context [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7eb38210-af3a-4045-a92c-aff35466c2af(cell1) {{(pid=120425) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 11:52:21.196776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.201045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:52:21.201519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:52:21.203137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:52:21.203866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:52:21.204315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:52:21.206302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:52:21.208337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Registered counter for database nova_cell0 Sep 12 11:52:21.212331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Registered counter for database nova_cell1 Sep 12 11:52:21.219597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.222006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.226111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.257193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.context [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7eb38210-af3a-4045-a92c-aff35466c2af(cell1) {{(pid=120424) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 11:52:21.261749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:52:21.262228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:52:21.263827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:52:21.264569 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:52:21.265016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:52:21.267024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:52:21.269025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Registered counter for database nova_cell0 Sep 12 11:52:21.273015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Registered counter for database nova_cell1 Sep 12 11:52:21.281508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.283677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.289238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.291235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.368370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.378928 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Registered counter for database nova_cell0 Sep 12 11:52:21.385458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.390642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.441607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Registered counter for database nova_cell0 Sep 12 11:52:21.449134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 11:52:21.454101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 11:52:21.709090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:52:21.716509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:52:21.772853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:52:21.781163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:52:22.065388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:52:22.071397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-8e11daff-fd2a-411b-9106-67b7f6221813 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:52:22.077216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578f7ee09c0 pid: 120425 (default app) Sep 12 11:52:22.122988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 11:52:22.128926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b75d8c84-0756-4d8f-a77c-2e198b238d1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 11:52:22.134231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578f7ee09c0 pid: 120424 (default app) Sep 12 11:52:58.605223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:52:58.606024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:52:58.607799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:52:58.611629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:00.139613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-250620b7-bd17-441a-9ca9-7063dcf5fcc9 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Action: 'create', calling method: .version_select at 0x7fc93b306430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2100634049"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:01.369374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-250620b7-bd17-441a-9ca9-7063dcf5fcc9 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.784584 Sep 12 11:53:01.370613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Sep 12 11:52:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 11:53:01.387123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:01.388192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:01.389371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:01.391695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:01.700224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-42042efb-ec15-41b9-ad8d-a510c008a4eb tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b353280>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:02.415082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46beff6c-eb37-4d73-a9f0-75d18f94da01 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b1d9310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:02.560501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-42042efb-ec15-41b9-ad8d-a510c008a4eb tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 200 len: 346 microversion: 2.1 time: 1.178556 Sep 12 11:53:02.563026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:01 2022] GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 346 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:02.576102 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4502a74-0ad5-4158-bde8-72f83402b96c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Action: 'create', calling method: .version_select at 0x7fc93b218280>, body: {"snapshot": {"volume_id": "adef04ac-37c0-4120-bf6c-e0e3b30f655f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1207574314"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:02.616013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46beff6c-eb37-4d73-a9f0-75d18f94da01 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/70c4e002-7f84-40ee-a4cf-b55046b24ecb" status: 200 len: 351 microversion: 2.1 time: 0.205034 Sep 12 11:53:02.625076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:02 2022] GET /compute/v2.1/os-volumes/70c4e002-7f84-40ee-a4cf-b55046b24ecb => generated 351 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:53:03.096645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4502a74-0ad5-4158-bde8-72f83402b96c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.525259 Sep 12 11:53:03.103486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 2/4] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Sep 12 11:53:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:03.108797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc5a2ed4-c246-4a82-abc6-b6421af3ca32 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1d9a60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:03.503065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc5a2ed4-c246-4a82-abc6-b6421af3ca32 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.398135 Sep 12 11:53:03.504374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:03 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:03.517046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b03ee40-704a-4119-968b-8a39cb3d33e5 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e6160>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:03.628607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b03ee40-704a-4119-968b-8a39cb3d33e5 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.116088 Sep 12 11:53:03.636325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Sep 12 11:53:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:03.642826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d57adf2a-1d45-42c4-8171-4fef23fd0376 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1741f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:03.729175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d57adf2a-1d45-42c4-8171-4fef23fd0376 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.091052 Sep 12 11:53:03.735185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:03 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:04.742663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12853313-b43c-4e61-8742-d829235c07f7 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e9550>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:04.836879 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12853313-b43c-4e61-8742-d829235c07f7 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.097993 Sep 12 11:53:04.838437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:04 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:05.851954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-faecd340-7c9c-46c4-bdb8-98258a529584 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1d9b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:05.918830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-faecd340-7c9c-46c4-bdb8-98258a529584 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.072169 Sep 12 11:53:05.925477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:05 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:06.934900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c2ad56d-9d92-4041-b197-2cc43fc7dab2 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e6790>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:06.990694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0c2ad56d-9d92-4041-b197-2cc43fc7dab2 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.061960 Sep 12 11:53:06.991849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:06 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:08.003659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60f0ea0d-3ecb-41b6-b618-bf0e3f255c31 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1d9430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:08.060558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60f0ea0d-3ecb-41b6-b618-bf0e3f255c31 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.060740 Sep 12 11:53:08.061123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:07 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:53:09.075280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78803718-3f4b-4c9b-8a02-1e987434b60d tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e6040>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:09.266628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78803718-3f4b-4c9b-8a02-1e987434b60d tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.197207 Sep 12 11:53:09.267502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:09 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:10.128812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bef0667-5c8a-4f8a-8ef5-49cc049716ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: .version_select at 0x7fc93b174310>, body: {"keypair": {"name": "tempest-keypair-927605939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILM7DrN9/o5IYdxGKamxDqMJh9oP33DklSH+iqqlPCU2alVi19bREsOrlD9NCl9RBkwU8ESJljKZv2bLloeltyKYz6b6/9PlCoZNuLS32TT2H/G0y0dsdlOTsg8It0ljw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:10.222872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-7bef0667-5c8a-4f8a-8ef5-49cc049716ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for project 0356e6690066437a86fc69833ff4cb69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:10.236257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-7bef0667-5c8a-4f8a-8ef5-49cc049716ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for user 6e3c1f7f6f8649a991d5d8a15eb8826b and project 0356e6690066437a86fc69833ff4cb69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:10.282939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c85f381-86ec-4467-9ce7-a01f48da055d tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93bb33af0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:10.347979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1c85f381-86ec-4467-9ce7-a01f48da055d tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 288 microversion: 2.1 time: 0.071468 Sep 12 11:53:10.349029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:10 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:53:10.364909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bb769431-d68c-468d-8ac6-4c391810594c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e6f70>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:10.369623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bef0667-5c8a-4f8a-8ef5-49cc049716ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.495117 Sep 12 11:53:10.371833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 7/14] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Sep 12 11:53:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 500 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 11:53:10.494320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bb769431-d68c-468d-8ac6-4c391810594c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 202 len: 0 microversion: 2.1 time: 0.136453 Sep 12 11:53:10.495571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Sep 12 11:53:10 2022] DELETE /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:53:10.505047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-936ede3f-1022-42bf-908b-3b6f387987ee tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b152790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:10.561093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-936ede3f-1022-42bf-908b-3b6f387987ee tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 200 len: 287 microversion: 2.1 time: 0.061393 Sep 12 11:53:10.562138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:10 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:11.409459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d138fb8b-9af1-4e1d-bffb-b559501b8d34 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b1e61f0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:11.512071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d138fb8b-9af1-4e1d-bffb-b559501b8d34 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ca21fdbf-bbed-4664-8b15-8e6d8a4f24c7" status: 200 len: 351 microversion: 2.1 time: 0.107343 Sep 12 11:53:11.513179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 9/17] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:11 2022] GET /compute/v2.1/os-volumes/ca21fdbf-bbed-4664-8b15-8e6d8a4f24c7 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:11.576569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-364d63c3-e090-441b-bc6a-5575f2e9fbfe tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b152e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:11.630055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-364d63c3-e090-441b-bc6a-5575f2e9fbfe tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] HTTP exception thrown: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-364d63c3-e090-441b-bc6a-5575f2e9fbfe tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Request method failure captured: Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f HTTP/1.1 Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2affVvFkixIsayc5zT2mWVvdCkH8o7R5od3EmMYICpS_P2oiGA41nZkYBmMtszEs8F3XrSFkFyCzviA9oJ2H0O4ZN2gmb40q38kwOJQaBBenQONfsWs-lZpRxZxHcxWB7Yaq2yhqN7Ltb5HMWrIok9_ePPT-tUIV8389OkuQV8E_Y Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: b8f53720176046919919835156882fff Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:53:11.635607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f53720176046919919835156882fff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f53720176046919919835156882fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}] Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: b8f53720176046919919835156882fff Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 2e316a50d94143809bb686b18d07af8a Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '125dbded-8318-408e-bd14-3f6b52ce719f'} Sep 12 11:53:11.636810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. (HTTP 404) (Request-ID: req-3115b18f-ba49-41d3-ac94-918842d26891) Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.637466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:11.638335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 12 11:53:11.639320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-364d63c3-e090-441b-bc6a-5575f2e9fbfe tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Returning 404 to user: Snapshot 125dbded-8318-408e-bd14-3f6b52ce719f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:53:11.640417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-364d63c3-e090-441b-bc6a-5575f2e9fbfe tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f" status: 404 len: 111 microversion: 2.1 time: 0.065984 Sep 12 11:53:11.649190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0da04f6b-8152-44ce-99cb-57b8d37c260b tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b218310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:11.654968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 9/18] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 12 11:53:11 2022] GET /compute/v2.1/os-snapshots/125dbded-8318-408e-bd14-3f6b52ce719f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:53:11.808578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0da04f6b-8152-44ce-99cb-57b8d37c260b tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 202 len: 0 microversion: 2.1 time: 0.164208 Sep 12 11:53:11.819980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf716a58-e46e-40ed-92d1-8efa7c9514e5 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b0f6ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:11.820671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 10/19] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 11:53:11 2022] DELETE /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:53:11.926289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf716a58-e46e-40ed-92d1-8efa7c9514e5 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 200 len: 345 microversion: 2.1 time: 0.111238 Sep 12 11:53:11.934688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 10/20] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:11 2022] GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:12.943382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c4aa413-ffc9-4d22-b36e-04877c06da5c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b1e6700>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:12.989900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-0c4aa413-ffc9-4d22-b36e-04877c06da5c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] HTTP exception thrown: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c4aa413-ffc9-4d22-b36e-04877c06da5c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Request method failure captured: Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f HTTP/1.1 Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2affVvFkixIsayc5zT2mWVvdCkH8o7R5od3EmMYICpS_P2oiGA41nZkYBmMtszEs8F3XrSFkFyCzviA9oJ2H0O4ZN2gmb40q38kwOJQaBBenQONfsWs-lZpRxZxHcxWB7Yaq2yhqN7Ltb5HMWrIok9_ePPT-tUIV8389OkuQV8E_Y Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b8f53720176046919919835156882fff Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:53:12.997389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f53720176046919919835156882fff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f53720176046919919835156882fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}] Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b8f53720176046919919835156882fff Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 2e316a50d94143809bb686b18d07af8a Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'adef04ac-37c0-4120-bf6c-e0e3b30f655f'} Sep 12 11:53:12.998558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. (HTTP 404) (Request-ID: req-e7cb684f-0470-415b-b2c9-51a4b89dece2) Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:12.999275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:13.000357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 11:53:13.001278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.002175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.004564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c4aa413-ffc9-4d22-b36e-04877c06da5c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Returning 404 to user: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:53:13.005659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0c4aa413-ffc9-4d22-b36e-04877c06da5c tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 404 len: 109 microversion: 2.1 time: 0.067433 Sep 12 11:53:13.007521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 11/21] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:12 2022] GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:53:13.030853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8189525-3358-47de-86bb-f59eb0251121 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93b0e1430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:13.099329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b8189525-3358-47de-86bb-f59eb0251121 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] HTTP exception thrown: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8189525-3358-47de-86bb-f59eb0251121 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Request method failure captured: Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f HTTP/1.1 Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2affVvFkixIsayc5zT2mWVvdCkH8o7R5od3EmMYICpS_P2oiGA41nZkYBmMtszEs8F3XrSFkFyCzviA9oJ2H0O4ZN2gmb40q38kwOJQaBBenQONfsWs-lZpRxZxHcxWB7Yaq2yhqN7Ltb5HMWrIok9_ePPT-tUIV8389OkuQV8E_Y Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: b8f53720176046919919835156882fff Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:53:13.102008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f53720176046919919835156882fff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f53720176046919919835156882fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}] Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: b8f53720176046919919835156882fff Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 2e316a50d94143809bb686b18d07af8a Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'adef04ac-37c0-4120-bf6c-e0e3b30f655f'} Sep 12 11:53:13.103942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. (HTTP 404) (Request-ID: req-772d0a68-2cbe-4d8c-aa7c-1750b6f3702a) Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.104730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 11:53:13.105896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 11:53:13.107041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.108201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.110172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8189525-3358-47de-86bb-f59eb0251121 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Returning 404 to user: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:53:13.111206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8189525-3358-47de-86bb-f59eb0251121 tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 404 len: 109 microversion: 2.1 time: 0.084763 Sep 12 11:53:13.112229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 11/22] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 11:53:13 2022] DELETE /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:53:13.121390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f02f5b14-dc5e-4f48-ac22-8c193ad4e01f tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Calling method '.version_select at 0x7fc93bb33430>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:13.190230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-f02f5b14-dc5e-4f48-ac22-8c193ad4e01f tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] HTTP exception thrown: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f02f5b14-dc5e-4f48-ac22-8c193ad4e01f tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Request method failure captured: Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f HTTP/1.1 Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2affVvFkixIsayc5zT2mWVvdCkH8o7R5od3EmMYICpS_P2oiGA41nZkYBmMtszEs8F3XrSFkFyCzviA9oJ2H0O4ZN2gmb40q38kwOJQaBBenQONfsWs-lZpRxZxHcxWB7Yaq2yhqN7Ltb5HMWrIok9_ePPT-tUIV8389OkuQV8E_Y Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b8f53720176046919919835156882fff Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:53:13.192260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f53720176046919919835156882fff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f53720176046919919835156882fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f53720176046919919835156882fff"}]}] Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b8f53720176046919919835156882fff Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2036284596 Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 2e316a50d94143809bb686b18d07af8a Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2036284596-project Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'adef04ac-37c0-4120-bf6c-e0e3b30f655f'} Sep 12 11:53:13.193590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. (HTTP 404) (Request-ID: req-8145aff1-f694-48f6-bb84-2f389d266dd3) Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.194381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 11:53:13.195645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 11:53:13.196798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f02f5b14-dc5e-4f48-ac22-8c193ad4e01f tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] Returning 404 to user: Volume adef04ac-37c0-4120-bf6c-e0e3b30f655f could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f02f5b14-dc5e-4f48-ac22-8c193ad4e01f tempest-VolumesSnapshotsTestJSON-2036284596 tempest-VolumesSnapshotsTestJSON-2036284596-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f" status: 404 len: 109 microversion: 2.1 time: 0.077393 Sep 12 11:53:13.198112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:13 2022] GET /compute/v2.1/os-volumes/adef04ac-37c0-4120-bf6c-e0e3b30f655f => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:53:13.346031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9edce5d2-8f49-4ab4-b1b5-0f47e30af490 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b0e14c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:13.508264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9edce5d2-8f49-4ab4-b1b5-0f47e30af490 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6922bba4-95a1-42fc-88b6-c70684e44610" status: 200 len: 350 microversion: 2.1 time: 0.166165 Sep 12 11:53:13.509990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 12/24] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 11:53:13 2022] GET /compute/v2.1/os-volumes/6922bba4-95a1-42fc-88b6-c70684e44610 => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:13.523486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b812d9d3-0961-4b07-b46c-9b3001692914 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b150310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:13.965913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b812d9d3-0961-4b07-b46c-9b3001692914 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.446089 Sep 12 11:53:13.967232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Sep 12 11:53:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:13.984987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb2559f6-65cf-44bc-adf9-e3dfab3ad8bc tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b0e1b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:14.328197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb2559f6-65cf-44bc-adf9-e3dfab3ad8bc tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.347180 Sep 12 11:53:14.328807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Sep 12 11:53:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:14.345649 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b77812c-278b-42cc-9c15-fcc8af28b70a tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b150940>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:14.595144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b77812c-278b-42cc-9c15-fcc8af28b70a tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.253147 Sep 12 11:53:14.595974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Sep 12 11:53:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:14.613875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2cb522c6-2f11-4701-a366-3074e0dd45c7 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b1e6c10>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:14.881218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2cb522c6-2f11-4701-a366-3074e0dd45c7 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.272807 Sep 12 11:53:14.882186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Sep 12 11:53:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:14.898939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e79adddb-9a21-4be1-9541-f9329f959811 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b14cb80>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:15.176429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e79adddb-9a21-4be1-9541-f9329f959811 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.284071 Sep 12 11:53:15.185246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Sep 12 11:53:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:15.186365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1710442766", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:15.200886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c6fcc299-3526-41ac-8009-2af7ec4c5798 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93b1e6670>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:15.436519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] validate_networks() for [('454d7b87-e358-46f8-af08-f1619c1182de', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:53:15.507839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c6fcc299-3526-41ac-8009-2af7ec4c5798 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.312469 Sep 12 11:53:15.508439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 17/30] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Sep 12 11:53:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:16.003726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-330170078", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "networks": [{"uuid": "91233534-8aaf-4eb5-9131-760de2d33b53"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:16.191976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] validate_networks() for [('91233534-8aaf-4eb5-9131-760de2d33b53', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:53:18.310635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:53:18.311654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:53:18.312276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:53:18.312832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:53:18.313435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:53:18.348058 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:18.348489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:18.357236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:18.360354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:18.361039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:18.361678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:18.419498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:18.425234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for user 66682d5656d3414eaebba666d4e0771f and project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:18.433090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:53:18.433615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:53:18.433977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:53:18.438670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:53:18.440077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:53:18.445689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:53:18.458021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:53:18.464527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:18.465524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:18.466109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:18.467358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:18.467997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:18.468852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:18.506833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Getting quotas for project b68484aca102406a914066e2cc11a452. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:18.516533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Getting quotas for user 23126c9640d6433e96d393b885f3f829 and project b68484aca102406a914066e2cc11a452. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:18.532560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:53:18.536717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:53:18.629432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09381fcb-fb98-44b0-877f-af46e2021183 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.061336 Sep 12 11:53:18.632558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 14/31] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:53:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:53:18.645539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e60fee36-6c86-4806-bef2-ebeb96e67f02 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93affc280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:18.719992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-767bba5a-16e3-4c48-b042-21f2a1662bc7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.208245 Sep 12 11:53:18.722925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 18/32] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:53:18.752228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-513701653", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17b03ad-5779-44c1-a615-ac6df97b3bc7"}], "security_groups": [{"name": "tempest-securitygroup--1035325790"}], "key_name": "tempest-keypair-927605939", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:18.891443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e60fee36-6c86-4806-bef2-ebeb96e67f02 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256771 Sep 12 11:53:18.892642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 15/33] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Sep 12 11:53:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:19.039241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] validate_networks() for [('e17b03ad-5779-44c1-a615-ac6df97b3bc7', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:53:19.800091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7add067-4a0d-44b6-ae1b-74d46f4c547e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: .version_select at 0x7fc93b018a60>, body: {"keypair": {"name": "tempest-keypair-1252202419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGg6eib+5sLzmc8TGFXVRAH+FyrCxrYWlZXlUStBbADzWbzc9CUI6ORLHVG0NX/xrI+wIAKY40xI3HdLQAg0h0/lIhw/56P6DJ3iMJ8sYrdvn4vjvMiIehMK7TxviUiGw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:19.840202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-d7add067-4a0d-44b6-ae1b-74d46f4c547e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:19.848861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-d7add067-4a0d-44b6-ae1b-74d46f4c547e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:19.903770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7add067-4a0d-44b6-ae1b-74d46f4c547e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.009793 Sep 12 11:53:19.908894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 11:53:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:19.918109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-381c10b0-5152-4282-a55c-2e668312b102 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:19.919160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-381c10b0-5152-4282-a55c-2e668312b102 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:19.935380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:53:19.935873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:53:19.936273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:53:19.936854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:53:19.937934 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:53:19.955079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:19.960517 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:19.962892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:19.965909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:19.968476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:19.970474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:20.054876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for project 0356e6690066437a86fc69833ff4cb69. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:20.072789 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for user 6e3c1f7f6f8649a991d5d8a15eb8826b and project 0356e6690066437a86fc69833ff4cb69. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:20.141806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:53:20.145856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:53:20.265906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4d3939da-5c76-437f-b9dc-b2530c6253b4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.541670 Sep 12 11:53:20.277726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 19/35] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Sep 12 11:53:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 11:53:20.288609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-965f5c53-f429-4d62-8c0f-d953c15844b4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:20.289504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-965f5c53-f429-4d62-8c0f-d953c15844b4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:20.311995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-381c10b0-5152-4282-a55c-2e668312b102 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:20.354459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-381c10b0-5152-4282-a55c-2e668312b102 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1222 microversion: 2.1 time: 0.438793 Sep 12 11:53:20.357512 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 17/36] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:19 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1222 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:20.374238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0655c14-92e8-437c-a1a5-7b76d0835c28 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] Calling method '.version_select at 0x7fc93affc790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:20.596661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-965f5c53-f429-4d62-8c0f-d953c15844b4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:20.649350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-965f5c53-f429-4d62-8c0f-d953c15844b4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1214 microversion: 2.1 time: 0.370748 Sep 12 11:53:20.654468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 20/37] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:20 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:20.662720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:20.668674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:20.760734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0655c14-92e8-437c-a1a5-7b76d0835c28 tempest-VolumesTestJSON-19261952 tempest-VolumesTestJSON-19261952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.401814 Sep 12 11:53:20.761894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 18/38] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Sep 12 11:53:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:20.935229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-137805321", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:20.980809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:21.007298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:21.014428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:21.018487 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b0bab191-8977-43dd-8924-614736fa31de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1280 microversion: 2.20 time: 0.361972 Sep 12 11:53:21.022654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 21/39] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:20 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:21.122942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] validate_networks() for [('454d7b87-e358-46f8-af08-f1619c1182de', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:53:21.680745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f59f4512-1b4e-4b5c-acd0-18931ae12ac7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:21.681777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f59f4512-1b4e-4b5c-acd0-18931ae12ac7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:21.938094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:53:21.938721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:53:21.939168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:53:21.939809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:53:21.940270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:53:21.954345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:21.956513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:21.957523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:21.959433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:21.960079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:21.960930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:21.988808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:21.995339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for user 66682d5656d3414eaebba666d4e0771f and project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:22.011557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:53:22.018741 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:53:22.161611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e9c9b69-b780-47d2-9457-6b5243eddba2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.232195 Sep 12 11:53:22.171841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:53:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 11:53:22.184819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:22.188022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:22.204933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:22.207726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:22.212855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:22.213845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:22.215211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:22.216672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:22.223738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f59f4512-1b4e-4b5c-acd0-18931ae12ac7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:22.233438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f59f4512-1b4e-4b5c-acd0-18931ae12ac7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1214 microversion: 2.1 time: 0.557308 Sep 12 11:53:22.234057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:21 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1214 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:22.286860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9add4b31-5941-4094-a331-9ab3c6134228 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:22.288705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9add4b31-5941-4094-a331-9ab3c6134228 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:22.697720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9add4b31-5941-4094-a331-9ab3c6134228 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:22.727554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9add4b31-5941-4094-a331-9ab3c6134228 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1221 microversion: 2.1 time: 0.462050 Sep 12 11:53:22.729252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 23/42] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:22 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1221 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:22.743665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:22.761099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:22.762835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:22.776405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a55bb153-61a3-48a1-89c5-32f7092b5d4f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1276 microversion: 2.20 time: 0.590870 Sep 12 11:53:22.777155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 20/43] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:22 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1276 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:23.260643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:23.261328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:23.280363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:23.285243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:23.286329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:23.288807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:23.294803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:23.295338 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:23.757429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:23.760065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:23.779213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:23.781498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:23.784000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:23.786249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:23.795875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:23.797128 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:23.933183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:23.950424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-114b5a41-aa1d-4f0d-858a-4813a5a7288c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1217 microversion: 2.1 time: 0.197018 Sep 12 11:53:23.971885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 21/44] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:23 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:23.986025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:23.991326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:24.012379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:24.034302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b39563c-23de-405c-a535-d09ad7408ebe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1210 microversion: 2.1 time: 0.777924 Sep 12 11:53:24.036426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 24/45] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:23 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1210 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:24.051709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:24.052084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:24.062003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:24.067097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:24.069999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:24.073519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:24.541594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:24.567429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:24.574246 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:24.580205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cafe443-a097-4448-8cc4-cd4877df610d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1332 microversion: 2.20 time: 0.603075 Sep 12 11:53:24.583349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 22/46] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:23 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1332 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:24.978903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:24.979264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:24.992779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:24.993982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:24.996205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:24.997572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:24.999059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:25.001203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:25.060955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:25.062206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:25.073514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:25.079339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:25.079994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:25.083046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:25.087500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:25.091107 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:25.270066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:25.282937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d610c514-15b7-49f7-8f59-341bdbc9a94f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1274 microversion: 2.1 time: 0.226490 Sep 12 11:53:25.283539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:25 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:25.566744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:25.586051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-64952260-cd2a-4f12-901f-1984da4a45eb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1273 microversion: 2.1 time: 0.611505 Sep 12 11:53:25.587027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:24 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1273 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:25.613905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:25.614995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:25.627169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:25.628877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:25.631016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:25.632510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:25.633304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:25.633990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:25.819643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1217403967", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea7071fe-73d4-4a9c-bf82-37346c7e58c4"}], "security_groups": [{"name": "tempest-securitygroup--946177975"}], "key_name": "tempest-keypair-1252202419", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:26.133551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:26.150822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:26.158898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:26.161748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c0ffbe1-4a38-43a1-8c7e-cf17464f9cb8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1338 microversion: 2.20 time: 0.552006 Sep 12 11:53:26.163645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:25 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1338 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:26.313184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:26.313825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:26.327401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:26.328562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:26.329594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:26.330902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:26.333532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:26.334949 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:26.454986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] validate_networks() for [('ea7071fe-73d4-4a9c-bf82-37346c7e58c4', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:53:26.537588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:26.549838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-315dc5be-90c5-46e6-a8d6-fbee24ee3301 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1272 microversion: 2.1 time: 0.245171 Sep 12 11:53:26.550273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:26 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:26.626173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:26.627303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:26.645841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:26.646416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:26.649230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:26.650421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:26.650941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:26.651418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:26.857335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:26.875552 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-935aae0f-90fa-4e7d-af33-ed85c9009b83 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1281 microversion: 2.1 time: 0.254715 Sep 12 11:53:26.878482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 26/51] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:26 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:27.206394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:27.209971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:27.235109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:27.235711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:27.236122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:27.236908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:27.243158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:27.244049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:27.726082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:27.737572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:27.739155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:27.740299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-156aa067-6e6f-489e-a927-cd7852cf0b41 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1338 microversion: 2.20 time: 0.546312 Sep 12 11:53:27.757648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:27 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1338 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:27.770823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:27.771673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:27.788292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:27.789570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:27.791360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:27.794542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:27.795263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:27.796551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:28.351281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:53:28.351281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:53:28.351281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:53:28.351281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:53:28.351281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:53:28.399380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:28.409570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:28.423572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:28.425137 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:28.426046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:28.428412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:28.489506 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:53:28.496213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:53:28.538632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:53:28.545567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:53:28.670741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a99fdc67-a5c5-4180-ae7f-0ee0f2e70dcd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.856340 Sep 12 11:53:28.671802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 26/53] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:53:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 11:53:28.687058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:28.688157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:28.694697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:28.704194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0228fd2-2927-4986-bb3e-00ccfd2d3511 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1272 microversion: 2.1 time: 0.944989 Sep 12 11:53:28.709812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:28.710318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:28.710948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 28/54] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:27 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1272 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:28.724959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-329e3239-739c-4f4a-a994-966110ca8145 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:28.729894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:28.730248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-329e3239-739c-4f4a-a994-966110ca8145 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:28.737722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:28.738107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:28.738585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:28.952228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:28.979753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8dc9cc99-5af3-46da-9b09-21b748f344ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1279 microversion: 2.1 time: 0.303547 Sep 12 11:53:28.996636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:28 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:29.003225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:29.004629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:29.013278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:29.014528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:29.015225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:29.016378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:29.017088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:29.017754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:29.119376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-329e3239-739c-4f4a-a994-966110ca8145 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:29.131995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-329e3239-739c-4f4a-a994-966110ca8145 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1242 microversion: 2.1 time: 0.415627 Sep 12 11:53:29.132415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:28 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1242 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:29.743260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:29.743260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:29.756092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:29.763833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:29.764598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:29.766223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:29.770072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:29.772761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:30.813662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:30.824625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40b951ae-ef8e-4c27-99f7-e54ecf749556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 1.090003 Sep 12 11:53:30.829016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 30/57] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:29 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:30.835668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:30.837125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:30.862404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:30.862960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:30.863404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:30.864114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:30.864572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:30.865000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:30.911717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:30.959907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:30.974415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:30.977651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4647fca-1a3a-4613-a255-190b81c548b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 1.979162 Sep 12 11:53:30.985551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 28/58] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:28 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:31.012915 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:31.016170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:31.037635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:31.045545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:31.046996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:31.051821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:31.055845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:31.059267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:31.371381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:31.379350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-15eac178-4f6c-4440-a13b-e94952557a37 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1294 microversion: 2.1 time: 0.391440 Sep 12 11:53:31.384891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:30 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1294 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:31.748076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:31.758379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1688eb9-4a12-4b28-b941-524a6a4ef755 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1279 microversion: 2.1 time: 0.927647 Sep 12 11:53:31.760326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 31/60] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:30 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1279 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:31.853236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:31.854494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:31.881871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:31.900761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:31.904178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:31.905316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:31.914916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:31.915816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.012854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:32.013657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:32.033461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:32.038405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.039652 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.042031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.045989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.047541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.053299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.527441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:32.549105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:32.561146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:32.569529 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a3ee9f3-0db4-40df-87b5-9de8578c47d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.555039 Sep 12 11:53:32.571689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 32/61] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:32 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:32.591520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:32.592144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:32.602775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.603327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.603915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.604640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.606333 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.606955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.879901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:32.903101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df2a4950-a472-4a8a-a1e3-3fb5ba06c264 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1300 microversion: 2.1 time: 0.328876 Sep 12 11:53:32.920948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 33/62] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:32 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:32.927663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:32.942056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:32.963936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.964607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.967632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:32.968673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:32.971355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:32.971972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:33.535382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:33.550685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b46b26e-89a3-42c8-aa04-a6d9dac41060 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.621597 Sep 12 11:53:33.552610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 34/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:32 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:33.605035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:33.605895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:33.624481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:33.629756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:33.630428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:33.633479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:33.634864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:33.636037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:33.877618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:33.890186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20375e84-0111-407d-aac9-fbd40a932362 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 2.040760 Sep 12 11:53:33.892916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 30/64] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:31 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:33.934250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:33.935146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:33.952407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:33.955090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:33.955567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:33.956307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:33.956777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:33.958339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:34.257344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:34.270291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd3e229f-7ac4-470e-9741-cafd94b537b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1300 microversion: 2.1 time: 0.341476 Sep 12 11:53:34.270920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:33 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1300 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:34.575783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:34.576662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:34.587468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:34.590809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:34.592032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:34.592880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:34.593399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:34.593846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:35.506314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:35.519158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-322aead4-d08e-4fe7-ab47-185bd228dfb3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.943140 Sep 12 11:53:35.520355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 32/66] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:34 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:35.536784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:35.537927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:35.548937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:35.550918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:35.552896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:35.553921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:35.555427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:35.558444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:35.643526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:35.666244 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:35.677080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:35.679322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18f7570a-8e99-4789-a581-b45d473e3ec3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 2.081549 Sep 12 11:53:35.682719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 35/67] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:35.693677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:35.694332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:35.716137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:35.716641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:35.717081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:35.717805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:35.718263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:35.718725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:36.058994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:36.063219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:36.081350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-159799a5-1499-4389-9852-250218ad65fe tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1300 microversion: 2.1 time: 0.393600 Sep 12 11:53:36.082151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 36/68] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:35 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1300 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:36.300852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:36.315996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e049526-7256-4e10-9e23-0ecf384ff2b2 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.792116 Sep 12 11:53:36.318225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 33/69] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:35 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:36.556305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:36.559776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:36.587739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:36.602393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:36.602946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:36.606078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:36.606768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:36.610022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.030426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4310e71e-de3e-4855-8800-8bb60f9d8428", "tag": "902c7450-29c6-4c7a-8480-15a41b613dc5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:37.067224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.067717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.068156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.154009 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Creating event network-changed:902c7450-29c6-4c7a-8480-15a41b613dc5 for instance 4310e71e-de3e-4855-8800-8bb60f9d8428 on hv-cinder-85331 Sep 12 11:53:37.159937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 11:53:37.160843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3ef79f7-55b2-4b89-852a-87c52a50d5b4 req-41ed8853-b762-4ff0-a850-bc55f498afb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 11:53:37.162215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.164466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.165356 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.168429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.171074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.172206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.203396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.compute.rpcapi [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 11:53:37.205553 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] Releasing lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 11:53:37.233415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6289b0d-c146-4cdb-a569-afba77456190 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.140392 Sep 12 11:53:37.243337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 37/70] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:37.263160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:37.264062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:37.272436 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:37.276210 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.277061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.277832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.278840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.279515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.280484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.312190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:37.320981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0a955b9a-4d70-4c0e-82cd-107b6b235b1a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.778515 Sep 12 11:53:37.324321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 34/71] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:36 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:37.333968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:37.336843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:37.356735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.357333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.357962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.358907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.359432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.359920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.589411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:37.603325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:37.609016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:37.611204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-038da721-e878-473b-95da-058fe4ee93ad tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.364862 Sep 12 11:53:37.613724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 38/72] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:37 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:37.805984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:37.816809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7bac6d06-f61d-43d7-84cc-b78d214c00c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.491097 Sep 12 11:53:37.823699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 35/73] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:37 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:37.828678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:37.831671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:37.850581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.851906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.852655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:37.854122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:37.854613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:37.855212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.051989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea7ece5-4d6f-4665-9921-916f547c633a", "tag": "36f5b056-844b-43e1-a1c7-eefdca3b6f3d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:38.063414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:38.068626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.069478 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.070761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.083203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7d5f936-e988-4a5f-99e5-16a9928c049d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.258278 Sep 12 11:53:38.087929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] Creating event network-changed:36f5b056-844b-43e1-a1c7-eefdca3b6f3d for instance 5ea7ece5-4d6f-4665-9921-916f547c633a on hv-cinder-85331 Sep 12 11:53:38.098506 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:37 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:38.109360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-001c2e16-bf68-4300-a033-36f3aa9a2614 req-4444795e-3615-42cb-9822-6e2d1675865c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491648 Sep 12 11:53:38.110103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 39/75] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:38.349276 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:38.350299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:38.357158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.357949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.358618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.359492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.360108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.360679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.457959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:38.515469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=26 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:38.622035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:38.638662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-057752dc-ba20-4779-8e15-1f584e79f417 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.291773 Sep 12 11:53:38.644593 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:38.646159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:38.648223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 37/76] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:38 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:38.658613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.659466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.660186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.661673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.662718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.663302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.814679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:38.825209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:38.826770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:38.827776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57169205-9cd7-412c-9e04-bf8a2ab96ee5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.187811 Sep 12 11:53:38.828353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 40/77] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:38 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:38.845656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:38.846133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:38.852715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.853757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.854403 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:38.855331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:38.856188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:38.856794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.114147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:39.116054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:39.131160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=24 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:39.133376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.133719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.134152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.155550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.156042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.156482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.293421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:39.306430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-280e5f05-4b16-439f-9b24-38c5d4ec5987 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.465050 Sep 12 11:53:39.307816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 38/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:38 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:39.318443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}, {"name": "network-changed", "server_uuid": "635b3409-f52c-4b47-85ed-dec792d0bd8d", "tag": "e3afbefc-1ce9-4a84-b30a-e5117f9cfa67"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:39.359919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.367419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.368206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.444886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Creating event network-changed:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:53:39.447528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Creating event network-changed:e3afbefc-1ce9-4a84-b30a-e5117f9cfa67 for instance 635b3409-f52c-4b47-85ed-dec792d0bd8d on hv-cinder-85331 Sep 12 11:53:39.448571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 11:53:39.449038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-547e25af-4d1c-4593-9e4f-eb58f564c2d5 req-255015c0-cfd0-442e-af61-d8cac695bb95 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 11:53:39.450612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.451528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.452376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.453324 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.454615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.455335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.470451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.compute.rpcapi [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 11:53:39.472209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] Releasing lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 11:53:39.494488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-44a66fd5-0c87-4827-8591-3d7e87bce8ac None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.185245 Sep 12 11:53:39.495779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 39/79] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:53:39.631243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:39.642124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b1a1145-9a6e-4a94-9734-c9e87a1bd219 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.534274 Sep 12 11:53:39.643335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 41/80] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:39 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:39.664241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:39.666364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:39.670625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:39.675327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.676080 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.676823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.678122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.678673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.680004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.856661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:39.857561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:39.864493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:39.866726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.867454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.868650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.869277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:39.870064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:39.870773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:39.871373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:39.874865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dff3f110-0192-4b6d-8de2-34fe66a8ac31 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.215271 Sep 12 11:53:39.890428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 40/81] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:39 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:40.051121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:40.060925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:40.063161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:40.064276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de81b3f3-23b7-4e1f-ab73-f991c31632e7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.211970 Sep 12 11:53:40.064987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 42/82] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:39 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:40.151059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2d709d-f003-488e-9bb0-bfb75d0f69ab", "tag": "b25efa2e-fad4-493f-9130-67c7da820a60"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:40.161377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.161923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.162463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.175238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] Creating event network-changed:b25efa2e-fad4-493f-9130-67c7da820a60 for instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab on hv-cinder-85331 Sep 12 11:53:40.181308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-b7eab423-1ca7-436c-94c9-b2b3ffcecc61 req-8186fc9f-c8e4-4143-a9b3-5e9bb23b459a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035596 Sep 12 11:53:40.182175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 41/83] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:53:40.340467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:40.342259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:40.350998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.352129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.352321 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.353580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.354293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.355108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.531298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:40.540702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d714e4e-6021-4054-8caa-56082af77441 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.210299 Sep 12 11:53:40.541962 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:40 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:40.665692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:40.666430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:40.674331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.674853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.675518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.676180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.676640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.677060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.834615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:40.850133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c8f471c8-7525-45b2-a963-32c62fbb9f1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.183268 Sep 12 11:53:40.851152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:40 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:40.897460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:40.898791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:40.905760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.906194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.906773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:40.907477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:40.907916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:40.908334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.096577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:41.097128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:41.103528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.104326 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.105005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.105850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.106373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.106906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.125927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:41.135119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9355b069-ac47-4fa2-87c3-d05dfe85a77c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.241387 Sep 12 11:53:41.136003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 44/86] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:40 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:41.289723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:41.298575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:41.300083 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:41.301206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b6871dd7-6b35-4e1f-8cce-1c3f96a0dbbe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.208659 Sep 12 11:53:41.302012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 43/87] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:41 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:41.563785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:41.564465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:41.571115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.571936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.572429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.573182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.573701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.574189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.734428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:41.743084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e7ca446-e68f-47cd-8c20-9757af586d0b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.182916 Sep 12 11:53:41.744174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 45/88] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:41 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:41.886629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:41.887000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:41.899159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.899853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.901084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:41.904640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:41.905358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:41.906475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.158027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:42.158693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:42.168429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.168934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.169478 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.171520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.171993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.172428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.403726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.422483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-548bab6b-1b06-41c3-ae55-5dc40a91d317 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.544307 Sep 12 11:53:42.424039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 44/89] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:41 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:42.431844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:42.432589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:42.441335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.441830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.442260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.443722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.445496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.446035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.453375 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.462955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1155e6a2-eb0c-4bce-b26c-5e8dc3500ff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.308609 Sep 12 11:53:42.463883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:42 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:42.632108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.640504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.641965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.643118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c8e3187e-1f0b-49df-ad5d-db5f429fd1bc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.218002 Sep 12 11:53:42.643683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 45/91] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:42 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:42.769644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:42.770300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:42.777243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.777768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.778203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.778916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:42.779369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:42.779789 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:42.937291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:42.948774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58516f53-48a2-4d21-a32f-8f4a6bbb1df1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.184389 Sep 12 11:53:42.949913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:42 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:43.450881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:43.451502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:43.457493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.457985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.458421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.459142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.459708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.460962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.489157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:43.490100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:43.496412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.496971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.497701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.498603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.499115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.499538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.616080 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:43.624882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-87b61267-694f-4f9c-8ad3-f9cc025f8a32 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.178304 Sep 12 11:53:43.625455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 46/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:43 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:43.661733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:43.669000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:43.669701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:43.676167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.676735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.677086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-600c4711-6e0d-4c7b-af0d-da894f82a46f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.191167 Sep 12 11:53:43.677430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.678196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.679067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.679686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.689458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 48/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:43 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:43.831373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:43.840944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:43.842285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:43.843330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-56ceeee3-d7fc-429e-9fef-37ab82943811 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.179130 Sep 12 11:53:43.844039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 47/95] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:43 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:43.973449 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:43.974651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:43.981488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.981805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.982236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:43.982966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:43.983408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:43.984068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.129543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:44.140096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60eba276-a66d-4ba0-9936-043424a28757 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.171446 Sep 12 11:53:44.154842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 49/96] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:43 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:44.650188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:44.651011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:44.657366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.657921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.658587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.659385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.660026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.660453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.702254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:44.705868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:44.716421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.717302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.718011 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.719068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.719814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.720557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.834372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:44.848588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4244884-f563-4fe1-aadb-a262e39dab71 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.203316 Sep 12 11:53:44.849165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 48/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:44 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:44.869675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:44.870778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:44.878467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.879191 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.879857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.881010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:44.881626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:44.882320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:44.898473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:44.919046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3b5a94d-8d5e-4919-837a-4f390b1b39cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.220340 Sep 12 11:53:44.919941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 50/98] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:44 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:45.045342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:45.055308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:45.056836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:45.057945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e08ed99c-6765-4444-ac69-d0ae1d0890f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.193425 Sep 12 11:53:45.058528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 49/99] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:44 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:45.163662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:45.164331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:45.170183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.170709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.171147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:45.171836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.172368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.172960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:45.307686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:45.316603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c29e4a34-6963-4559-8da7-d41e1ffe1149 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.157191 Sep 12 11:53:45.317294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 51/100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:45 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:45.871572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:45.872180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:45.878149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.878639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.879070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:45.879748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.880196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.880617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:45.942648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:45.943240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:45.950316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.950803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.951237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:45.951918 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:45.952368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:45.952788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:46.017408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.026405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c857bc18-8fc6-44e4-bcc3-ac27c4be41da tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.158537 Sep 12 11:53:46.042670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:45 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:46.085204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:46.086132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:46.095023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:46.095542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:46.095977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:46.096763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:46.097220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:46.097639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:46.098156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.108342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-173b5220-8cb4-4bc1-94c5-b712d295f7f9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.169557 Sep 12 11:53:46.109588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 52/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:45 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:46.246715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.255144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.256565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.258293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7eb20296-896e-4297-ab25-6d99b1508f78 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.178707 Sep 12 11:53:46.259040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 51/103] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:46 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:46.340438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:46.341068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:46.347097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:46.347577 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:46.348008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:46.348690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:46.349140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:46.349562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:46.506469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:46.521965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e36ce15-08ae-41c6-8009-3af8f5570045 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.185097 Sep 12 11:53:46.523263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 53/104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:46 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:47.052132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:47.052674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:47.058801 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.059283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.059709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.060382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.060829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.061249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.134691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:47.134897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:47.140704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.141179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.141608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.142283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.142760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.143180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.161497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:47.194969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:47.197748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.205829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-98662507-3665-45a2-96f0-9961e701bfb7 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.157563 Sep 12 11:53:47.206391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 52/105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:47 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:47.280339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.283371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:47.283978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:47.290113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.290300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4532eec3-8a32-4714-b8f1-57bb8364b622 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.160227 Sep 12 11:53:47.290637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.295069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 54/106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:47 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:47.295206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.295206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.295206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.295206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.422760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.431348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.432796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.433897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7dd243c5-6905-4a3f-8679-3ccb78f1bba2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.154363 Sep 12 11:53:47.434477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 53/107] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:47 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:47.544540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:47.545141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:47.551129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.551634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.552066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.552873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:47.553330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:47.554265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:47.684140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:47.692191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00a63509-79d6-41d9-9e9a-3ed68ae7a538 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.151453 Sep 12 11:53:47.692755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 55/108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:47 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:48.229575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:48.230184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:48.236488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.236973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.237405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.238095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.238583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.239011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.313305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:48.313917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:48.320008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.320436 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.320873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.321827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.322280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.322734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.383314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.392026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-623b783b-3313-4eaf-b045-5066d1a327be tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.166771 Sep 12 11:53:48.392612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 54/109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:48 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:48.457411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.461918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:48.462551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:48.467194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e95258e7-e961-4074-a036-b5d0c26532fe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.157667 Sep 12 11:53:48.467779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:48 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:48.468705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.469157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.469598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.470304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.470792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.471212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.602219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.610309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.611796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.612918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9d428911-fe2c-45f8-8d39-37e79944a40e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.155515 Sep 12 11:53:48.613478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 55/111] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:48 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:48.716378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:48.716992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:48.723296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.723774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.724205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.724882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:48.725430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:48.725878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:48.862725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:48.870648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bca5e4c7-ef27-4dae-ae6e-bf0f369ededd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.158019 Sep 12 11:53:48.871212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 57/112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:48 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:49.415613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:49.416228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:49.422226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.422760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.423202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.423891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.424348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.424777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.469093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:49.490567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:49.491803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:49.499573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.500054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.500632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.501324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.501770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.502192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.558566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:49.566249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a65ff9d3-8336-4025-9976-5f798f70a746 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.154857 Sep 12 11:53:49.567175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 56/113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:49 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:49.636485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:49.637635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:49.638249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:49.644390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-923db8ca-bd81-4e97-80cb-106162344c0c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.157579 Sep 12 11:53:49.644525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.644897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.645026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 58/114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:49 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:49.645650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.646350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.646880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.647479 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.778219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:49.786377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:49.788449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:49.789584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-72d19ca5-ca49-41f5-8cf2-d62bbd759926 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.156052 Sep 12 11:53:49.790139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 57/115] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:49 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:49.893737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:49.894333 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:49.900983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.901461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.901892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:49.902602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:49.903059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:49.903482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.038778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.047021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9a17a38-b0bd-4ff9-9899-6ef5f9d6f37c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156943 Sep 12 11:53:50.047602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 59/116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:49 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:50.589886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:50.590385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:50.596269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.596746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.597177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.597846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.598297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.598741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.602672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:50.667747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:50.668442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:50.675637 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.676124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.676556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.677282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.677730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.678152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.740082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.749734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a496c14-3296-454d-a8cb-57c62e53a0a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.163276 Sep 12 11:53:50.751167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 58/117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:50 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:50.815745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:50.816478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:50.816990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.824119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.824748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.825174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.825856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:50.826177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd5062ab-e422-46da-b047-3c6dd9bb0cbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.162313 Sep 12 11:53:50.826302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:50.826978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:50.827089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 60/118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:50 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:50.963172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.971973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.973404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:50.974553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4b737e97-bb01-4f64-8ffb-f01b5801c42d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.163424 Sep 12 11:53:50.975113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 59/119] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:50 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:53:51.069363 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:51.070067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:51.076489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.076969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.077405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.078088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.078559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.078979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.208889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:51.216582 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ab602ad-941a-4d7c-8f5f-5eb5e12051d3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.151140 Sep 12 11:53:51.217149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 61/120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:51 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:51.778389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:51.779024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:51.790989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.792538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.793144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.793862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.794313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.794904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.851561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:51.852591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:51.866221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.866742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.867366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.868066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:51.868513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:51.868931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:51.956293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:51.964828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-08415406-4712-4918-a11b-48b4a615f87e tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.190666 Sep 12 11:53:51.965658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 60/121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:51 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:52.001583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:52.002475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:52.011145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:52.012190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:52.013015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:52.013738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:52.014200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:52.014632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:52.040176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:52.047985 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c9ea379-8ad3-4b6a-90f1-df55447a8a34 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.200565 Sep 12 11:53:52.048651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 62/122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:51 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:52.181211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:52.189825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:52.191448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:52.192628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dce99c33-1eaa-45d7-8352-d5d5873aa2d3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.196022 Sep 12 11:53:52.193544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 61/123] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:51 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:52.242318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:52.242980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:52.249074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:52.249549 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:52.250133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:52.250668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:52.251117 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:52.251589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:52.387924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:52.395862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcda353e-18e2-4986-9f26-5f34e3ac403c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.158293 Sep 12 11:53:52.396435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 63/124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:52 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:52.991716 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:52.992615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:53.000393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.001025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.001637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.002325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.002944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.003512 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.073260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:53.074797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:53.082784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.083551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.084182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.086274 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.086900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.087518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.223895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.232315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0193fef9-e14a-4f7f-a1aa-d9100bec18ed tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.245492 Sep 12 11:53:53.233370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 62/125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:52 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:53.237945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:53.238729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:53.245688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.246166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.246610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.247434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.248029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.248622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.251752 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.262125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efcd85b7-613d-48e6-8e5b-7e4188ca6044 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.193311 Sep 12 11:53:53.263214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 64/126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:53 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:53.435518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.446006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.448607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.450195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8151d60f-c2ce-4cb5-ae67-5c09dbeb32e8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.215775 Sep 12 11:53:53.451299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 63/127] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:53 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:53.455830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:53.456661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:53.463529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.464233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.464864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.465779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.466322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.466963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.485455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4310e71e-de3e-4855-8800-8bb60f9d8428", "name": "network-vif-plugged", "status": "completed", "tag": "902c7450-29c6-4c7a-8480-15a41b613dc5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:53:53.490038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:53.490171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:53.490531 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:53.503359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] Creating event network-vif-plugged:902c7450-29c6-4c7a-8480-15a41b613dc5 for instance 4310e71e-de3e-4855-8800-8bb60f9d8428 on hv-cinder-85331 Sep 12 11:53:53.512161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4f8d20bd-15a4-4a03-9b37-9d8f4219272e req-34a77065-26fb-496e-b57f-4a8a530f4d2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115086 Sep 12 11:53:53.512979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 65/128] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:53:53.624623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:53.631197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5e798961-47d2-4519-b4df-d2da08fbaac9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.178749 Sep 12 11:53:53.632497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 64/129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:53 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:54.256807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:54.257998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:54.264189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.264666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.265101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.265785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.266237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.266686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.284925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:54.285524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:54.292574 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.293060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.293521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.294188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.294670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.295095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.403658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.411604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6d59076-5bd2-4d27-9d88-f1194257a16f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.159205 Sep 12 11:53:54.415683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 66/130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:54 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:54.434872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.442408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0f8d06c4-3f4d-4770-8113-e3411bd6e402 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.161274 Sep 12 11:53:54.443000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 65/131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:54 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:54.476318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:54.477049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:54.482924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.483402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.483830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.484504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.484948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.485361 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.613598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.621945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.623433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.624521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8db654e2-c376-4389-9828-0567996c500c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153043 Sep 12 11:53:54.625073 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 67/132] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:54 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:54.656662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:54.657306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:54.664815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.665300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.665736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.666427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:54.666908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:54.667331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:54.804184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:54.812034 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0b095fa-1c60-4036-9cbf-ccc04dfb193e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.161519 Sep 12 11:53:54.812606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 66/133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:54 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:55.434808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:55.435417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:55.441296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.441772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.442200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.442894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.443341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.443758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.465758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:55.466366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:55.472283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.472761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.473195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.473876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.474328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.474775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.579367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.588598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f2d4b84-08b1-4b4f-b0f6-7de6c80c56fb tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.157604 Sep 12 11:53:55.589414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 68/134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:55 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:55.606941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.614408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cddfe813-a904-45ed-bbe6-4257c0273434 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.152484 Sep 12 11:53:55.615056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:55 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:55.650412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:55.651243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:55.657888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.658371 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.658834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.659526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.659973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.660396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.793443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.801416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.802944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.804026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1065617-2b4f-4ff0-97fb-d49f25477c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.158788 Sep 12 11:53:55.804572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 69/136] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:55 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:55.835505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:55.836116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:55.842660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.843144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.843577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.844257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:55.844712 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:55.845140 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:55.981245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:55.988722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4997c22f-f946-4a69-980e-a30906f66298 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.157066 Sep 12 11:53:55.989294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:55 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:56.611640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:56.612314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:56.618231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.619436 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.620078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.622182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.622182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.622182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.637779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:56.638566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:56.645164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.645920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.646603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.647374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.647890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.648374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.772132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:56.780100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c66eeee-e25d-4b91-9462-9c50ac27ce9c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.172463 Sep 12 11:53:56.780672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 70/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:56 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:56.794033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:56.802084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a755edb7-7bf8-4cf8-ac56-2b8d45031310 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.168651 Sep 12 11:53:56.802678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:56 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:56.829739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:56.830347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:56.836242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.836714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.837156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.837929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:56.838380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:56.838836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:56.969356 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:56.973610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:56.979782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:56.981298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:56.982339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bb29731-6774-4cc3-b3ad-7e851aef9fdb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.156524 Sep 12 11:53:56.982946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 71/140] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:56 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:57.012348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:57.013341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:57.019615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.020216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.020717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.021493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.022016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.022502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.154002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:57.161722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1a9dda11-ffd5-4983-822b-81b48957cbe2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.153725 Sep 12 11:53:57.162164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 70/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:57 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:57.802958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:57.803589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:57.809847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.810492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.811059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.811830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.812376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.812889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.825855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:57.826568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:57.832519 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.832991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.833419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.834093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:57.834559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:57.834978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:57.944377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:57.952935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-765f9a65-1d0f-4326-800f-b47305f1b986 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.153974 Sep 12 11:53:57.953508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 72/142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:57 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:57.966093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:57.973913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f855dff-09df-4289-acf3-0c0a4c03b49e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.152727 Sep 12 11:53:57.974481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 71/143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:57 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:53:58.007331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:58.007944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:58.014679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.015163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.015601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.016280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.016744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.017164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.150579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:58.158567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:58.160019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:58.161108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6ab60f8-4d7f-42fb-beb2-96e3c83fd684 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.157632 Sep 12 11:53:58.161664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 73/144] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:58 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:58.184088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:58.184699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:58.190670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.190996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.191585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.192118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.192549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.192972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.324779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:58.332461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf9b527c-ab36-4738-9a4e-878c46e01590 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.152700 Sep 12 11:53:58.333031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 72/145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:58 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:58.976292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:58.976960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:58.983627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.984676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.985423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:58.985938 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:58.986422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:58.997013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:59.000529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:59.012636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.013133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.013747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.014449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.014936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.015364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.127207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.136698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-468c27a8-6732-4f3e-8e0a-34799ab2dec3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.164158 Sep 12 11:53:59.137817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 74/146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:58 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:59.150629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.159002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-967e1b84-fbdd-4a7e-8a6b-74fc0e6e7b8e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.166176 Sep 12 11:53:59.159591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 73/147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:58 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:53:59.185480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:59.186079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:59.192664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.193139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.193564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.194412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.195094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.195671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.336245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.344898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.346322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.347443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b2b742b-19d7-4c42-b976-93029a4f85d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.165776 Sep 12 11:53:59.347992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 75/148] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:53:59 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:53:59.355401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:53:59.356027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:53:59.362108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.362696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.363190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.363933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:53:59.364448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:53:59.364929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:53:59.497704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:53:59.501166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:53:59.506549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b6920c7-e758-49de-93fe-670ad33d1c85 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.155068 Sep 12 11:53:59.507139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 74/149] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:53:59 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:00.160455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:00.161072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:00.167654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.168130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.168565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.169236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.169688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.170109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.181891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:00.182792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:00.188645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.189129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.189572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.190253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.190749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.191176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.339369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.343813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.347775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0e4f2c3-f2a5-4b0b-b61c-2086a2117c36 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.170489 Sep 12 11:54:00.348462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:00 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:00.367492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0765ee0d-eb17-493c-a493-e6c18f3f68e6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.210131 Sep 12 11:54:00.369511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:00 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:00.373447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:00.374059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:00.379944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.380484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.381182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.382106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.382583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.383166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.530092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:00.531185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:00.539982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.541276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.542348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.543541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:00.544523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:00.545633 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:00.715196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.721678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.723988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.726267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:00.727411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a3128db6-95c7-4201-989b-9a3de7ff4d44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.358804 Sep 12 11:54:00.728553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 76/152] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:00 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:00.741650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65a92e4f-0834-4804-9ab5-655ba4a7a71a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.215564 Sep 12 11:54:00.756782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:00 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:01.365660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea7ece5-4d6f-4665-9921-916f547c633a", "name": "network-vif-plugged", "status": "completed", "tag": "36f5b056-844b-43e1-a1c7-eefdca3b6f3d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:54:01.374482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:01.378992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:01.394875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.395412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.395733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.396237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.396577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.397236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.397498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.398620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.399150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.415693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] Creating event network-vif-plugged:36f5b056-844b-43e1-a1c7-eefdca3b6f3d for instance 5ea7ece5-4d6f-4665-9921-916f547c633a on hv-cinder-85331 Sep 12 11:54:01.420895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-591fd256-f3b2-4f4c-9845-8bfb6a2a0265 req-a0175373-01d1-44e7-992e-84bd3d067719 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061519 Sep 12 11:54:01.422404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 77/154] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:54:01.428927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:01.429858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:01.438188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.439185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.439813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.440811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.441460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.442541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.648849 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.657366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07aec1ac-04a1-4d47-b470-c6be662e324a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.289457 Sep 12 11:54:01.658186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:01 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:01.664099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.678256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae385fde-9aa5-4e66-906f-3d13c294b093 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.254606 Sep 12 11:54:01.679003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:01 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:01.755652 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:01.756257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:01.764255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.764811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.766118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.766842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.767305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.767739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.782538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:01.794044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:01.806583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.807226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.807675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.808536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:01.808854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:01.809283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:01.959253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.969262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3f4179f8-d753-43f3-828e-f9c430410467 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.201266 Sep 12 11:54:01.970288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:01 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:01.974805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.984851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.986635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:01.987753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dc6d02c-6813-4032-91ab-0f62d3d74bb4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.235976 Sep 12 11:54:01.988310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 79/158] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:01 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:02.680769 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:02.681459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:02.687634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:02.688113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:02.688544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:02.689351 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:02.689801 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:02.690217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:02.702735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:02.703346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:02.718277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:02.719061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:02.719576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:02.720395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:02.720951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:02.721445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:02.847962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:02.860192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-05da325f-cbc7-4e3c-858a-7c812a4a1532 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.181850 Sep 12 11:54:02.860192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 80/159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:02 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:02.890179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:02.898067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bafa88c-0b11-4430-aa38-9f7dc3fb4ac5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.200165 Sep 12 11:54:02.898649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:02 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:02.992149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:02.992750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:02.999782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.000367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.000799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.001483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.001928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.002424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.013679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:03.014355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:03.021367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.021852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.022284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.023000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.023611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.024042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.148632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:03.157648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1a3e205a-ad16-47c3-adad-61e21e3546bc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.169174 Sep 12 11:54:03.158403 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:02 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:03.169165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:03.178331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:03.180203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:03.181516 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb8c00bf-550c-49a8-8ea1-63bfd7f102d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.171907 Sep 12 11:54:03.182141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 81/162] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:03 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:03.881903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:03.882446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:03.888999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.889436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.889873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.890630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.891089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.891516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.921835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:03.922579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:03.929229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.929710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.931611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:03.932466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:03.933397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:03.933979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:04.039236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.051843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12dca6d8-3765-4eb9-98a2-b3854bf009a4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.173848 Sep 12 11:54:04.052788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:03 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:04.074644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.088444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9ab0824-661e-43cc-a56e-9d2724b20044 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.170219 Sep 12 11:54:04.089246 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:03 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:04.181797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:04.182413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:04.188445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:04.188927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:04.189368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:04.190053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:04.190527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:04.190961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:04.207972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:04.209259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:04.218093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:04.218708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:04.219133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:04.219824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:04.220275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:04.220712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:04.339854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.347829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ff0b7bf7-39c0-4e42-93d7-185f1e068c91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.170365 Sep 12 11:54:04.348388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:04 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:04.369681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.379561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.381100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:04.382637 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2aca8a9f-6653-409f-ae5b-33f75590e190 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.178615 Sep 12 11:54:04.383335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 83/166] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:04 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:05.082556 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:05.083118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:05.089671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.090162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.090619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.091311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.091762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.092186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.111439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:05.112707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:05.121935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.122466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.128889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.129770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.130354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.130914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.225828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.233838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-404ab8d3-dd26-4551-9e0f-583b701c19df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.155197 Sep 12 11:54:05.234412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 84/167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:05 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:05.261480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.268940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-513b9b09-5f44-4bb4-aad6-efa9e0f27759 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.161365 Sep 12 11:54:05.269492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:05 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:05.371571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:05.372183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:05.378021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.378502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.378971 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.379652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.380106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.380536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.411816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:05.412417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:05.418399 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.418908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.419340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.420012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:05.420457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:05.420911 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:05.509750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.517354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78570dfe-b65c-4244-9461-cf5886568d2e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.150042 Sep 12 11:54:05.517931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 85/169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:05 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:05.553698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.562261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.563830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:05.564926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4566eff9-5663-465a-948c-dbaba0694e9a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.156951 Sep 12 11:54:05.565518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 85/170] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:05 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:06.257097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:06.257730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:06.263777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.264243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.264666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.265331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.265776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.266190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.292014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:06.292612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:06.298644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.299120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.299550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.300232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.300697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.301118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.401539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.409202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-66e88719-c62e-4c55-b76d-d31d6a9a3115 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.155857 Sep 12 11:54:06.409769 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 86/171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:06 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:06.437360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.444994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-014de7d2-ca56-4502-8508-14c4844fd75f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.157205 Sep 12 11:54:06.445578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:06 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:06.539619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:06.541132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:06.547063 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.547547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.547979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.548658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.549112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.549537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.590048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:06.590685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:06.596650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.597063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.597508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.598201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:06.598691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:06.599120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:06.684692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.692605 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4ecd0e23-f772-41d6-bef4-645a59c4d4fc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156819 Sep 12 11:54:06.693197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 87/173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:06 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:06.737102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.745377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.746839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:06.747942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25f7654e-0192-4796-ae94-96744bfd04ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.162633 Sep 12 11:54:06.748497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 87/174] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:06 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:07.432489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:07.433878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:07.440617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.441231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.441892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.442978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.443727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.444242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.472147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:07.473322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:07.482607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:07.487327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.489829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.492323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.493474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.494244 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.495230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.531320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:07.622233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.630008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4a0ea902-4351-4869-9f27-6934f58864b7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.201509 Sep 12 11:54:07.630606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:07 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:07.716937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.719439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:07.720914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:07.725965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc03b855-6fdf-427d-b25f-1a54682c4a01 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.261291 Sep 12 11:54:07.726818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 88/176] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:07 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:07.729875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.730449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.731003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.731937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.732385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.732826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.773138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:07.773822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:07.780014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.780513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.786823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.787639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:07.788171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:07.788624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:07.894541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.906557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0cd73232-03de-4681-982a-726693289e6b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.193727 Sep 12 11:54:07.912297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:07 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:07.952048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.965198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.966795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:07.968021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-53905970-bf63-45fb-82b5-46223cee447f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.198704 Sep 12 11:54:07.969008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 89/178] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:07 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:08.653486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:08.654098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:08.657234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:08.660935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.661517 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.662068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.663047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.663540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.664186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.753308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:08.753859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:08.765744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.766498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.767155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.767859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.768312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.768738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.816814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:08.824846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-402d7d54-1648-4fe8-bda4-c3db681ea956 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.175195 Sep 12 11:54:08.825440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 90/179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:08 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:08.843989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "name": "network-vif-plugged", "status": "completed", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:54:08.854564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.855177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.855724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.871802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] Creating event network-vif-plugged:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:54:08.876918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-9bc4b977-45d4-425a-8284-45c3bcaeb542 req-b758dc64-5f64-41b3-bad1-b8018dd012b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038397 Sep 12 11:54:08.877524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 91/180] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:54:08.915209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:08.922968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09918398-cf2f-4fdd-bf67-c88191069ee5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.173853 Sep 12 11:54:08.923528 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 90/181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:08 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:08.929726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:08.930698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:08.937585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.938130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.938651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.939390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:08.939841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:08.940290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:08.993924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:08.994677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:09.000571 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.001045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.001470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:09.002154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.002631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.003051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:09.074067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:09.077549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:09.082502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-21e6c9c2-76b8-4b4b-b452-9ba5c1a4de31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156880 Sep 12 11:54:09.083096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 92/182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:08 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:09.135102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:09.143040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:09.144477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:09.145565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e341929a-b968-45bc-bf72-3f0f14ee7217 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.156157 Sep 12 11:54:09.146119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 91/183] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:08 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:09.847714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:09.848623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:09.856685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.857284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.857848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:09.858696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.859099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.859526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:09.948790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:09.949466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:09.955873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.956624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.957054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:09.957742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:09.958622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:09.958981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:10.005691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.016024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d5f4fd51-0b0c-4ab9-a6bc-42aeb3222f85 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.172493 Sep 12 11:54:10.016998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 93/184] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:09 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:10.093265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.101410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f93257c4-64f1-4652-9569-0c0c27ff12d6 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.158438 Sep 12 11:54:10.101844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 92/185] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:09 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:10.120266 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:10.121259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:10.127680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:10.128170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:10.128606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:10.129303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:10.129758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:10.130182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:10.172100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:10.172739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:10.179124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:10.179607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:10.180071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:10.181366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:10.182026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:10.182451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:10.276540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.288251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a41ce9e6-266c-4315-83d8-cad0f26b43c6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.183730 Sep 12 11:54:10.288251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 94/186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:10 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:10.556716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.565432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.566993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:10.568176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9698952-aecb-4b19-80f3-a15650b356aa tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.400526 Sep 12 11:54:10.568819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 93/187] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:10 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:11.038416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:11.039156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:11.046100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.046698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.047134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.047824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.048295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.048705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.125904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:11.126721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:11.133622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.134151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.135175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.135821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.136283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.136712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.195730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.205612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-91d1168d-336e-4812-a1f6-327b6206b586 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.171090 Sep 12 11:54:11.206498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 95/188] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:11 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:11.278542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.286129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9903777-6cc1-4341-aa02-189c4049b204 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.164816 Sep 12 11:54:11.286729 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 94/189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:11 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:11.309648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:11.310393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:11.316764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.317328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.317835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.318637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.319163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.319694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.460938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.469747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abc77386-2b26-4d96-ad08-2d6790cde121 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.164407 Sep 12 11:54:11.470323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 96/190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:11 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:11.594996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:11.595690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:11.601580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.602218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.602707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.603893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:11.604340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:11.604759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:11.733626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.741923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.743392 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:11.744591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27e06630-4eb0-4f08-af1e-fe35590e0716 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153472 Sep 12 11:54:11.745140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 95/191] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:11 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:12.232928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:12.233524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:12.239399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.239876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.240307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.240981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.241431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.241847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.310707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:12.311408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:12.318675 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.319248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.319749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.320507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.321296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.322849 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.387409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.396985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e91ebfb1-73f9-427d-b680-a9c121ff2dd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.168087 Sep 12 11:54:12.397845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 97/192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:12 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:12.472549 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.480531 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0229f97-2b21-4bb9-b9d9-19d5cddc3747 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.173824 Sep 12 11:54:12.481034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 96/193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:12 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:12.493344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:12.494101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:12.500195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.500658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.501093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.501775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.502249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.502693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.656504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.664084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d808cce-fbea-4085-92df-d2f627fd36af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.174849 Sep 12 11:54:12.664874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 98/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:12 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:12.771181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:12.771795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:12.778681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.779173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.779604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.780304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:12.780754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:12.781175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:12.916774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.925913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.927411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:12.928508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05cba772-4ad9-44b3-a649-ba7e5aaa324a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.161396 Sep 12 11:54:12.932704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 97/195] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:12 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:13.421086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:13.421814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:13.428002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.428483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.428909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.429702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.430195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.430635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.503902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:13.504511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:13.510348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.510863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.511892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.512383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.512840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.513253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.575263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:13.584290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f75fdd96-6cf1-4c47-adbc-d9780c89d48a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.166896 Sep 12 11:54:13.600804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:13 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:13.670891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:13.679974 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dfcf3532-4260-4552-86cc-08912955d57a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.179825 Sep 12 11:54:13.681486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 98/197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:13 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:13.687311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:13.688228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:13.694122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.694802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.695244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.696187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.696678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.697110 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.825868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:13.834551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-91024b41-1635-4b37-a31c-11b57f4eef25 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.151152 Sep 12 11:54:13.835300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:13 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:13.953472 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:13.954110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:13.960088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.960555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.961156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:13.961835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:13.962456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:13.963050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.103072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:14.111727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:14.113183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:14.114455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1961e51-e1b4-437e-acc9-f6153f2e966d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.164905 Sep 12 11:54:14.115422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 99/199] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:13 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:14.607666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:14.608269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:14.614166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.614681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.615212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.615819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.616273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.616707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.703629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:14.704237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:14.714793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.715505 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.717936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.718713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.719182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.719611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.786852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:14.795913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed6ce9d9-3d78-4633-953e-4415c00dd196 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.191912 Sep 12 11:54:14.802345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 101/200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:14 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:14.861333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:14.862048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:14.870783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.871479 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.872057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.872918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:14.873364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:14.874029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:14.901081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:14.908979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a12c807-f223-4a82-90e0-48cb94934b23 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.209260 Sep 12 11:54:14.910804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 100/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:14 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:15.035564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:15.045258 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-98e68bca-9f15-4cb6-a0f6-6a2bd76f91b6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.187645 Sep 12 11:54:15.045838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 102/202] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:14 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:15.139257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:15.139970 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:15.146193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.146858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.147407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.148148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.148657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.149443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.282408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:15.290881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:15.292444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:15.293541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4203fe8f-977e-4437-82cc-7a4d2222384b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.158343 Sep 12 11:54:15.294086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 101/203] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:15 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:15.819825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:15.820669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:15.828694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.829180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.829670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.830688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.831247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.831700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.933899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:15.934544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:15.940365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.940842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.941270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.941955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:15.942405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:15.942852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:15.965494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:15.973141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c8cb8364-0d41-4ee0-8dfb-1ceaadc9ebae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.158025 Sep 12 11:54:15.973721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 103/204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:15 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:16.069859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:16.070597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:16.077074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:16.077567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:16.077709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:16.078167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:16.078965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:16.079491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:16.079978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:16.085049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d083c29a-8408-421a-b29f-a942c361dc1f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.156062 Sep 12 11:54:16.085619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 102/205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:15 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:16.318092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:16.318803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:16.327529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:16.328119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:16.329353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:16.330095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:16.331217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:16.331996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:16.332830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:16.372241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-36d0cee3-38e8-4879-89f9-5e183c4d7857 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.306033 Sep 12 11:54:16.377524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:16 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:16.668717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:16.677391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:16.678871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:16.679980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e82ed1c0-8f1a-4521-aeef-6870755cb332 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.366666 Sep 12 11:54:16.680545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 103/207] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:16 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:16.997025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:16.997710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:17.003747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.004231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.004676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.005330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.005774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.006187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.120602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:17.121628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:17.130699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.131347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.132024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.132892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.134293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.135279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.201811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.209574 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-71219d85-21a8-42b0-a779-d85294b6e663 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.216483 Sep 12 11:54:17.210145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:16 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:17.276630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.284242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-badf2f3c-7045-4b64-b7e9-fa9fd744ab0c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.179672 Sep 12 11:54:17.284811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 104/209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:17 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:17.404393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:17.405036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:17.410884 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.411357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.411841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.412515 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.412963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.413378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.555387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.564012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6ec2304b-91a8-41e8-89c9-2ccd735ef7ac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.163527 Sep 12 11:54:17.578548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:17 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:17.705859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:17.706463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:17.712975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.713442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.713861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.714553 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:17.714997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:17.715411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:17.719306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:17.842710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.850708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.852140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:17.853724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13cbe563-50a2-4ec8-8e57-b531bc470643 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.151821 Sep 12 11:54:17.854314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 105/211] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:17 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:18.232304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:18.232905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:18.238775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.239248 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.239682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.240346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.240790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.241205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.307245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:18.307761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:18.313545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.314026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.314454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.315189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.315639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.316206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.369696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:18.377632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3fada940-1a71-4fe3-8bfd-189f2cf8538f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.149740 Sep 12 11:54:18.378205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:18 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:18.441880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:18.450317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5ab4fe4-eba4-4c81-a72a-14cb2957c91c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.146952 Sep 12 11:54:18.450900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:18 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:18.589656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:18.590182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:18.596052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.596520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.596974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.597639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.598085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.598497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.724034 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:18.731825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ddfc1af2-9a79-4716-beec-2c3fe530d2d4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.146567 Sep 12 11:54:18.732404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 108/214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:18 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:18.879101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:18.879703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:18.885819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.886291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.886750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:18.887418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:18.887862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:18.888275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.017947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.026461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.027930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.029026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03e64008-060d-405f-9491-2572d449e342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153760 Sep 12 11:54:19.029589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 107/215] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:18 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:19.401361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:19.401993 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:19.407987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.408462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.408893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.409563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.410011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.410431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.428398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:19.473362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:19.473963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:19.480498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.480992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.481403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.482079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.482552 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.482975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.543099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.550909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4bb5951f-f081-4eb8-9e92-6de67f8d6464 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.154039 Sep 12 11:54:19.551477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 109/216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:19 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:19.610677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.618404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbbea3a3-bbba-4dbf-9c6f-d53769e36721 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.148750 Sep 12 11:54:19.619110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 108/217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:19 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:19.754819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:19.755343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:19.761992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.762308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.762853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.763431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:19.763880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:19.764288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:19.893137 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:19.901314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4baef813-b534-4ae4-8bc8-311d30a94c3c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.150419 Sep 12 11:54:19.901875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 110/218] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:19 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:20.054130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:20.054767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:20.060718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.061204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.061640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.062324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.062804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.063232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.193514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:20.202473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:20.203930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:20.205020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4466a430-b821-4c3f-b800-d6cecc6f3594 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.154772 Sep 12 11:54:20.205572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 109/219] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:20 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:20.574596 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:20.575204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:20.581039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.581516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.581943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.582643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.583096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.583515 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.640845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:20.642138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:20.648052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.648534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.648966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.650269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.650750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.651179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.714863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:20.722296 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c803e25-a87e-4f20-b54e-e3eff871fa66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.152362 Sep 12 11:54:20.722909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 111/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:20 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:20.779556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:20.787002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-576aeebb-4deb-4fc9-80d7-02be368e72c9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.150043 Sep 12 11:54:20.787561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 110/221] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:20 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:20.923730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:20.924332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:20.930098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.931233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.931671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:20.932338 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:20.932784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:20.933198 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.061088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.068588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5fcbf491-c40e-447e-a46c-2fe62292d74f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.148664 Sep 12 11:54:21.069159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 112/222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:20 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:21.229533 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:21.230251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:21.236230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.236715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.237158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.237840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.238298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.238753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.365296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.375078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.376499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.377590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee74789c-512b-49ae-aefb-73b465eea8c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.152454 Sep 12 11:54:21.378148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 111/223] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:21 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:21.746116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:21.746646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:21.752545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.753020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.753444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.754114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.754601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.755018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.811248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:21.812018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:21.817919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.818402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.818884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.819551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:21.820005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:21.820426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:21.884087 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.891827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4ae7d48b-a706-47f0-8cb4-07f14ce6260f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.150625 Sep 12 11:54:21.892393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 113/224] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:21 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:21.952015 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:21.959934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a9a75ef-0b53-43bf-8010-2803ac77d051 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.152995 Sep 12 11:54:21.960517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 112/225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:21 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:22.092043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:22.092648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:22.098578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.099057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.099489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.100161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.100610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.101029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.236893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:22.245043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92e45074-aac9-44ed-892f-07efe4aa27cf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156884 Sep 12 11:54:22.245602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 114/226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:22 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:22.402849 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:22.403383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:22.409295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.409775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.410209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.410907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.411358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.411779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.537745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:22.546932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:22.548378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:22.549468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a715db5a-6b46-486e-a019-455feb9f5960 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.151144 Sep 12 11:54:22.550032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 113/227] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:22 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:22.915772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:22.916397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:22.922268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.922768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.923197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.923866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.924310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.924725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.989509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:22.990245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:22.997168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.997650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.998102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:22.998807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:22.999255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:22.999670 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:23.062467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.072683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8818fde6-ec92-413f-8efd-f7afecb757ac tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.160930 Sep 12 11:54:23.073517 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 115/228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:22 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:23.135453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.143040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00ce159b-9c69-4836-a9d2-c656e5a91e6f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.157454 Sep 12 11:54:23.143594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 114/229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:22 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:23.267354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:23.267886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:23.273691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:23.274679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:23.275105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:23.275764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:23.276204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:23.276615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:23.411848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.420025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae642088-e17e-482c-bbe0-ced0f549b147 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156534 Sep 12 11:54:23.420585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 116/230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:23 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:23.574317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:23.574876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:23.580871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:23.581343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:23.581769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:23.582438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:23.582916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:23.583330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:23.710572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.719248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.720663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:23.721742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21eceda5-d337-4f37-babe-367d08cd5a5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.152151 Sep 12 11:54:23.722290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 115/231] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:23 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:24.094776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:24.095382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:24.101187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.101667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.102101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.102804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.103254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.103852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.165716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:24.166445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:24.172207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.172683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.173112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.173779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.174223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.174665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.244308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.252413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f3273571-7762-41a6-a6a4-e8ad92794f92 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.161344 Sep 12 11:54:24.252991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 117/232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:24 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:24.315360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.323425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cae5d7fd-9cf1-4994-802e-a3fbe5637f0b tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.161527 Sep 12 11:54:24.324017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 116/233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:24 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:24.442965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:24.443577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:24.450098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.450624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.451043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.451723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.452169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.452592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.587603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.595018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-21bbb8ee-8df4-46f7-a1a1-85e82c2e2fec tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156372 Sep 12 11:54:24.595583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:24 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:24.746739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:24.747350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:24.753263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.753756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.754393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.754874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:24.755323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:24.755740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:24.886476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.894433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.895894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:24.896984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1804c922-fc61-43af-92d5-0e315897a7df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.154501 Sep 12 11:54:24.897538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 117/235] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:24 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:25.275781 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:25.276633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:25.282685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.283177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.283618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.284314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.284811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.285240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.345114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:25.345691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:25.351537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.352010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.352927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.353704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.354144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.354580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.418020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:25.425651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e50e71f4-70ce-4642-b5f2-717a1b0b9ee9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.153993 Sep 12 11:54:25.426223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:25 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:25.481997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:25.489499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74b7c974-eeea-4cf5-8095-c1078be4dd82 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.148193 Sep 12 11:54:25.490085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 118/237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:25 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:25.617331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:25.617967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:25.624395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.624867 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.625291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.625959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.626402 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.626848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.753640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:25.761313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-05a8f2cc-fa90-41ed-a160-c6150bcd3c31 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.147816 Sep 12 11:54:25.761885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:25 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:25.921936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:25.922549 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:25.928385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.928856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.929279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:25.929947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:25.930393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:25.931569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.060026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.067854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.069273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.070357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-352b3e54-11f0-4da9-8efd-23b7d3250253 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.152292 Sep 12 11:54:26.071743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 119/239] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:25 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:26.449281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:26.449906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:26.455710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.456180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.456603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.457295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.457741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.458156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.512479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:26.513093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:26.519259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.519723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.520318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.521002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.521456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.521884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.591941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.600004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-99f472d3-dfdb-4c3f-b33a-f903aafec245 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.155353 Sep 12 11:54:26.600828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 121/240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:26 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:26.652391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.660085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ecd323f-857d-417b-ab67-9c9371db9ea9 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.151534 Sep 12 11:54:26.660640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 120/241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:26 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:26.784562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:26.785109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:26.791533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.792010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.792443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.793125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:26.793579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:26.794000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:26.920533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:26.928104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b63829d-38b7-4f0b-ba57-a50a7b663e4e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.147438 Sep 12 11:54:26.928668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 122/242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:26 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:27.095789 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:27.096397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:27.102263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.103541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.103972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.104645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.105097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.105523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.234479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:27.237896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:27.242919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:27.244341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:27.245425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-972906f1-2652-4962-821a-0383b610fc8e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153506 Sep 12 11:54:27.245982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 121/243] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:27 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:27.626628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:27.627216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:27.633134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.634267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.634729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.635503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.635952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.636373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.683513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:27.684151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:27.690310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.690819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.691251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.691924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.692373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.692793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.772343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:27.780249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-083945dd-41bf-45f8-b0ce-a6b333c41768 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.157731 Sep 12 11:54:27.780816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 123/244] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:27 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:27.824826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:27.832271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1a0379f-bcc9-4c9f-bada-0b9ddf7c5da5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.153052 Sep 12 11:54:27.832833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:27 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:27.951213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:27.951766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:27.957690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.958161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.958613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:27.959283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:27.959731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:27.960144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.085813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:28.094342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f7bd99af-ed1a-436c-9a0c-8e43dfb2cc44 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.146979 Sep 12 11:54:28.094952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:27 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:28.270480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:28.271130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:28.277572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.278046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.278469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.279165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.279609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.280024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.425808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:28.436100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:28.436100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:28.440017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83f5e57a-c2eb-4bb9-95f3-acb0537d9b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.173146 Sep 12 11:54:28.450778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 123/247] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:28 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:28.532139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635b3409-f52c-4b47-85ed-dec792d0bd8d", "name": "network-vif-plugged", "status": "completed", "tag": "e3afbefc-1ce9-4a84-b30a-e5117f9cfa67"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:54:28.542101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.543267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.543694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.555139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] Creating event network-vif-plugged:e3afbefc-1ce9-4a84-b30a-e5117f9cfa67 for instance 635b3409-f52c-4b47-85ed-dec792d0bd8d on hv-cinder-85331 Sep 12 11:54:28.560602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a3dc2c39-ee41-473d-ace6-4fdefee9c27a req-d188caa0-994e-4794-b2ea-7c3626fd728f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Sep 12 11:54:28.561193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 125/248] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:54:28.807771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:28.808435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:28.814395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.814910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.815344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.816044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.816495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.816917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.856305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:28.857022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:28.863440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.863918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.864346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.865027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:28.865470 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:28.865885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:28.950204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:28.957992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-207c0c29-5198-48ed-a9d1-b01a3ee407cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.154602 Sep 12 11:54:28.971282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:28 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:28.998964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:29.002462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:29.007714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-edade398-be06-4417-afd1-bf5789e58fcd tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.156029 Sep 12 11:54:29.008222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 126/250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:28 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:29.117666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:29.117794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:29.124241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.124713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.125141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:29.125819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.126271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.126721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:29.261303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:29.268896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eafc052c-6f51-43a9-b358-cf3fdcc46307 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.155705 Sep 12 11:54:29.269456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 125/251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:29 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:29.479284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:29.479888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:29.487580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.488064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.488490 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:29.489166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.489646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.490015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:29.652541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:29.661968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:29.663429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:29.665806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-58d07a9e-0a30-4b95-bb5a-94b45e633347 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.191048 Sep 12 11:54:29.684107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 127/252] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:29 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:29.981587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:29.982852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:29.991844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.992319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.992746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:29.994166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:29.994559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:29.994979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.029897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:30.030538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:30.037224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.037912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.038349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.039069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.039522 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.040146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.143341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.152418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44edbba2-75d0-4783-bb13-ef782d84b2f1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.174736 Sep 12 11:54:30.153000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 126/253] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:29 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:30.176100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.184143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5ca014bb-644e-4764-8376-b3da2367ba90 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.158337 Sep 12 11:54:30.184706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 128/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:30 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:30.292919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:30.293443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:30.299301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.299773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.300198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.300874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.301328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.301736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.428215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.436248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58560560-90eb-4c37-bdee-5bb7158c85bb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.148137 Sep 12 11:54:30.436808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 127/255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:30 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:30.692049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:30.692799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:30.700504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.701260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.701896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.702848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:30.703493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:30.710127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:30.875337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.885391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.886989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:30.888078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b969700f-a450-4d25-b4f8-b1f4335b1752 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.199892 Sep 12 11:54:30.888630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 129/256] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:30 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:31.176378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:31.177230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:31.183637 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.184130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.184572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.185296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.185753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.186176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.207458 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:31.208062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:31.215249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.215730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.216157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.216836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.217303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.217700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.323882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:31.331968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d229252c-477e-464e-ab54-a682117775c8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.159368 Sep 12 11:54:31.332639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 128/257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:31 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:31.351595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:31.359135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2b633495-923c-4d4b-9f76-47f76a9c481f tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.155509 Sep 12 11:54:31.359698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 130/258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:31 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:31.460405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:31.461017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:31.467470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.467971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.468397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.469066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.469519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.469940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.596699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:31.604170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-554f9c07-e25f-47dc-b3c1-6a24fda115dc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.147902 Sep 12 11:54:31.604723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 129/259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:31 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:31.913151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:31.913752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:31.920155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.920632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.921059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:31.921736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:31.922181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:31.922628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.066890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.075605 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.077046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.078168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eabbb074-834a-401c-9aa5-bd32f1fa6ee4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.168967 Sep 12 11:54:32.078787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 131/260] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:31 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:32.356428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:32.356998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:32.363158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.363635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.364101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.364780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.365229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.365649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.382421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:32.383054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:32.389003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.389476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.389903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.390599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.391051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.391468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.499581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.507527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31c51187-64a5-4f9a-97eb-3b31d604aa87 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.155935 Sep 12 11:54:32.508115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 130/261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:32 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:32.627562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:32.628078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:32.633839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.634316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.634774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.635452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:32.635899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:32.636314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:32.693163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.701255 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2abfef5d-96a1-4b5e-92b2-7eb82b673221 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.322721 Sep 12 11:54:32.701825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 132/262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:32 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:32.763327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:32.771649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6e04ce7-5334-4309-b5b8-c77dc1ca2779 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.147963 Sep 12 11:54:32.772205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 131/263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:32 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:33.104747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:33.105353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:33.111554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.112035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.112468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.113153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.113606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.114027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.242182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.250766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.252199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.253292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b5a14f2-f107-4caa-9b30-e183a9389a75 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153623 Sep 12 11:54:33.254028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 133/264] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:33.531102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:33.531647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:33.537572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.538052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.538484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.539179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.540159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.540576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.670117 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.677609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-839e2257-2b60-425d-b3cf-36be3785abbb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.150445 Sep 12 11:54:33.678169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 132/265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:33 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:33.723607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:33.724239 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:33.730799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.731269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.731694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.732394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.732838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.733252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.794982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:33.795509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:33.801335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.801818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.802254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.802961 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:33.803800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:33.803800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:33.867842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.875468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b77f2de1-dfdf-4c49-8f67-2c9c543c9488 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.155635 Sep 12 11:54:33.876035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 134/266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:33 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:33.931957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:33.939559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af3b506b-0fd0-489a-ae86-b5ea9ab38ae3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.148530 Sep 12 11:54:33.940121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:33 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:34.279856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:34.280451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:34.286269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.286804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.287215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.288115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.289656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.290234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.420281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:34.428306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:34.429740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:34.430884 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-38ec0570-e8a2-4972-a614-fda5718d2db2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.154945 Sep 12 11:54:34.431450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 135/268] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:34 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:34.700405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:34.701008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:34.706921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.707394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.707818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.708540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.708986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.709400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.840290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:34.847929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7568574f-154e-4227-be39-722f2f55b860 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.151348 Sep 12 11:54:34.848488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:34 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:34.898278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:34.899558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:34.905476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.905969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.906381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.907088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.907539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.907957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.963407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:34.963932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:34.969852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.970332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.970813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:34.971496 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:34.971948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:34.972364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:35.044741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:35.052772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2f7233dd-6bbe-4a96-93d3-6b50fb990e46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.158259 Sep 12 11:54:35.053351 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:34 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:35.106104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:35.113822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3788f3c9-64f1-4507-a11b-b2ade1de863b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.154839 Sep 12 11:54:35.114653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 135/271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:34 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:35.455809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:35.456413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:35.462409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:35.462917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:35.463347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:35.464027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:35.464477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:35.464896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:35.591579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:35.599486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:35.600861 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:35.602493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-33766d7f-b7e0-4497-ad42-a20ecfa9ff16 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.150001 Sep 12 11:54:35.603072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 137/272] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:35 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:54:35.871511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:35.872059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:35.877981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:35.878456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:35.878910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:35.879580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:35.880027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:35.880445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.005783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.013603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6f6d20e-6f4e-451d-90a6-349d3ab32ff4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.146883 Sep 12 11:54:36.014160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:35 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:36.075305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:36.075911 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:36.082052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.082575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.083079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.083920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.084378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.084800 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.137856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:36.138605 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:36.144591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.145149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.145584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.146284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.146772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.147196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.222438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.231629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd19be6e-ef58-48f3-9383-e1a9937b2c17 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.160132 Sep 12 11:54:36.232240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 138/274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:36 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:36.311527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.319178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43523ba0-2475-4ae1-9acd-23a9c81a9654 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.185973 Sep 12 11:54:36.319745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 137/275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:36 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:36.627949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:36.628547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:36.634564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.635039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.635466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.636139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:36.636581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:36.636999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:36.764522 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.772674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.774696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:36.775850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2f538ba0-931b-49d3-ba35-b07bef030e81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.151810 Sep 12 11:54:36.776421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 139/276] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:36 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:37.036951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:37.037532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:37.039429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:37.044733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.045214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.045667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.046345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.046837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.047260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.064758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:37.183960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.195473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-682dc560-d3c8-4167-a461-64b1f185d9f0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.160447 Sep 12 11:54:37.195473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:37 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:37.254677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:37.255317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:37.264331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:37.268091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.268804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.269529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.270436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.271419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.272044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.343538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:37.344398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:37.351280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.351981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.352740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.353738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.354337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.354785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.417972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.425682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1f7196f2-a09d-40ad-930d-20885b108250 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.175425 Sep 12 11:54:37.426568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:37 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:37.499034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.507349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f158ec5-6fed-4b8e-80cb-f46d3a2a661b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.168769 Sep 12 11:54:37.507903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 139/279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:37 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:37.800923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:37.801728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:37.808579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.809307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.809907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.810625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.811242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.811664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.884554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2d709d-f003-488e-9bb0-bfb75d0f69ab", "name": "network-vif-plugged", "status": "completed", "tag": "b25efa2e-fad4-493f-9130-67c7da820a60"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:54:37.893882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:37.894593 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:37.895019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:37.906388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] Creating event network-vif-plugged:b25efa2e-fad4-493f-9130-67c7da820a60 for instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab on hv-cinder-85331 Sep 12 11:54:37.911579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1bc24b61-a3c2-45c8-8ab4-adccc24c9490 req-c268ec29-fa52-444a-8eac-14ae37d57643 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Sep 12 11:54:37.912165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 140/280] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:54:37.962675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.971334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.972896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:37.973979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-136d694a-98e2-474f-9e87-ce23efa93439 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.177032 Sep 12 11:54:37.974821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 141/281] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:37 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:38.218504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:38.219258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:38.225416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.225900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.226339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.227955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.228541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.228981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.376227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:38.384703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1035b2c9-6236-468f-9787-6871b02feb96 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.170361 Sep 12 11:54:38.385619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 141/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:38 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:38.449147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:38.449755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:38.456198 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.456763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.457209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.457967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.458629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.459061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.529659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:38.530257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:38.538923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.539962 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.540389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.543296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:38.543777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:38.544208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:38.630859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:38.645846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3176e9e0-997a-4390-be42-44ea8706c540 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.198271 Sep 12 11:54:38.646825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 142/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:38 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:38.710680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:38.719517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2dc6de1-4fd3-4306-bd65-2eb2af73328d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.193621 Sep 12 11:54:38.720719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 142/284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:38 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:39.000106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:39.000708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:39.006535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.007012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.007442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.008271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.008714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.009296 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.028509 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:39.187021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.195023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.196932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.198365 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-084cd467-cf47-4564-95a0-13a5c9141357 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.201996 Sep 12 11:54:39.199062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 143/285] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:38 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:39.409567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:39.410188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:39.416811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.417298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.417738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.418460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.418943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.419368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.552264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.560093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ee5c4f8-d567-4cbd-8739-e32626310de8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.154849 Sep 12 11:54:39.560714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:39 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:39.669525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:39.670264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:39.676268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.676834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.677353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.678112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.678759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.679253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.745906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:39.746530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:39.753610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.754092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.755402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.756460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:39.756890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:39.757313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:39.881319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.894555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a66c5600-99d7-411e-b97f-1fbfffbc6719 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.228737 Sep 12 11:54:39.895646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 144/287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:39 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:39.956876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:39.965593 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17df18c6-b14d-40bd-9fb3-1f029029d36f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.224229 Sep 12 11:54:39.969603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 144/288] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:39 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:40.224296 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:40.224925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:40.231422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.231903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.232331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.233013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.233463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.233882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.366887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:40.375452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:40.376914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:40.378020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4dd3e9e-e2a5-4e55-b32a-12ff9f1f6536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.157601 Sep 12 11:54:40.378641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 145/289] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:40 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:40.588921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:40.589667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:40.595927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.596630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.597155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.598003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.598843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.599271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.733431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:40.741131 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be06debe-9d84-453d-b48c-cfa77beb7a52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.161509 Sep 12 11:54:40.741690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 145/290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:40 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:40.918818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:40.919448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:40.925532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.926017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.926450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.927158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.927611 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.928033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.989362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:40.990137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:40.996411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.996968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.997493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:40.998255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:40.998742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:40.999172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:41.061512 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:41.069085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ac6796e4-5f8e-4527-bfdf-5f53da806f35 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.154070 Sep 12 11:54:41.069671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 146/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:40 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:41.130265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:41.138788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab34ef18-97cc-43bd-b317-aa723a3f8fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.153348 Sep 12 11:54:41.139354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:40 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:41.404086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:41.404690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:41.410496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:41.411015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:41.411444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:41.412113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:41.412564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:41.412984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:41.543476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:41.551352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:41.552790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:41.553848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-876121ad-6be5-462d-9938-c3096275550b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153766 Sep 12 11:54:41.554396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 147/293] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:41 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:41.763870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:41.764581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:41.770858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:41.771338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:41.771772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:41.772451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:41.772903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:41.773323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.083739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.091642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edbdf7af-4d58-4289-9d8d-82d15f4115e0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.331744 Sep 12 11:54:42.092101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:42.092568 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 147/294] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:41 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:42.092947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:42.098871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.099414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.099839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.100511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.100955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.101368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.161250 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:42.161861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:42.167845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.168270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.168706 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.169399 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.169868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.170282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.230820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.238319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ceba69d1-c716-40d7-ab0d-8aa1ff1f4cab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.150025 Sep 12 11:54:42.238922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 148/295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:42 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:42.298467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.306813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b752c50e-2e8e-4fc3-a3c1-f51092984523 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.149405 Sep 12 11:54:42.307376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:42 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:42.579606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:42.580219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:42.586052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.586930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.589514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.589514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:42.589514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:42.589514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:42.724247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.733424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.734985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:42.736183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d358e520-07e0-41b4-a151-d0711802f68a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.160540 Sep 12 11:54:42.736827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 149/297] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:42 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:43.114772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:43.115381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:43.122339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.122913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.123362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.124076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.124528 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.125019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.255707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.261215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:43.262052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:43.263890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d29cdd45-2650-4673-950c-21d973efdd18 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.152893 Sep 12 11:54:43.264710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:43 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:43.268313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.268788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.269215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.269887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.270388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.270868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.330017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:43.330563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:43.336900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.337383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.337830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.338529 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.339222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.339663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.405940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.413652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e9d1672-a141-47a6-8dcc-324a10fea728 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.156368 Sep 12 11:54:43.414292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 150/299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:43 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:43.473681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.482167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1612ed82-87e3-4560-99e0-757c23329154 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156265 Sep 12 11:54:43.482817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 150/300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:43 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:43.762753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:43.763539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:43.774900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.774900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.774900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.775963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:43.775963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:43.776155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:43.907865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.916412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.917905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:43.919052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de6074b8-c4dc-44ec-9640-6c493446cf00 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.160991 Sep 12 11:54:43.919641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 151/301] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:43 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:44.286582 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:44.287185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:44.293211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.293683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.294110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.294806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.295255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.295670 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.421643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:44.429192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6edc9d3b-a269-4216-9830-0c41072cf0ea tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.146461 Sep 12 11:54:44.430310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 151/302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:44 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:44.436739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:44.437445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:44.443325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.443809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.444242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.444920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.446448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.446893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.504903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:44.505513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:44.511749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.512233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.512658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.513342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.513786 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.514203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.583244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:44.590790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-62eb570d-e204-4820-ba2b-b3a0b2205030 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.157727 Sep 12 11:54:44.591357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 152/303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:44 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:44.641144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:44.648655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24c25533-ea32-4dfc-860b-04c39b006151 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.147545 Sep 12 11:54:44.649304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 152/304] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:44 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:44.942849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:44.943397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:44.950242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.950752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.951182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:44.951868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:44.952311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:44.952726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.087100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.095130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.096563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.097650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6a05a1ae-cf6c-4262-8b87-b51acf6c9bf0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.158778 Sep 12 11:54:45.098192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 153/305] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:44 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:45.453266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:45.453883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:45.459940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.460416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.460841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.461522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.461967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.462389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.598418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.605958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b89a34cf-86dc-4b26-abea-df36a3a3c966 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.157616 Sep 12 11:54:45.606524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 153/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:45 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:45.614124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:45.614909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:45.621552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.622156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.622632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.623321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.623779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.624202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.671656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:45.672651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:45.678990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.679477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.679910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.680630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:45.681115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:45.682052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:45.759511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.768825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7cdc02ec-ea82-426c-98c7-f7314944a556 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.158448 Sep 12 11:54:45.769516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 154/307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:45 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:45.813738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:45.821549 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efd78916-137a-4d44-8a4d-94f83d44cf4d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.153890 Sep 12 11:54:45.822185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 154/308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:45 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:46.124096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:46.124695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:46.130463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.130970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.131391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.132059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.132502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.132913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.261684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:46.269617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:46.271070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:46.272145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-04aa527d-adee-4025-bf2e-e0bac2ba544a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.152038 Sep 12 11:54:46.272691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 155/309] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:46 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:46.629192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:46.629795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:46.635852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.636330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.636757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.637430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.637874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.638290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.770473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:46.773983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:46.779863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36017fa5-dd4e-49b2-bc28-3ee83bd6e83a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.154449 Sep 12 11:54:46.780441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 155/310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:46 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:46.792712 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:46.793365 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:46.799215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.799685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.800106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.800773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.801217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.801632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.845026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:46.845631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:46.851835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.852332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.852788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.853574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:46.854044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:46.854485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:46.947054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:46.955591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5a4ea24f-3ad5-4b26-8a74-dfffb8e1b1d1 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.166909 Sep 12 11:54:46.956556 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 156/311] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:46 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:46.994336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:47.002301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a8b0a38-9b9d-4c2a-abee-b0b80bb400a5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.161138 Sep 12 11:54:47.002887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 156/312] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:46 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:47.297534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:47.298282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:47.306339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.307411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.307966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:47.308663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.309140 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.309559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:47.444692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:47.453091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:47.454569 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:47.455723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d527aacc-d238-443b-9c21-abf0a5debd35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.162293 Sep 12 11:54:47.456322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 157/313] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:47 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:47.802699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:47.803260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:47.809937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.810410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.810930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:47.811607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.812061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.812480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:47.938900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:47.947107 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c02133b0-a931-4544-be99-8d809c85d95f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.148289 Sep 12 11:54:47.947782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 157/314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:47 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:47.980414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:47.981024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:47.986958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.987439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.987875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:47.988552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:47.989006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:47.989430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.027007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:48.027829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:48.034827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.034827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.035380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.036271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.036830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.037350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.130888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:48.139500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-84a36dd2-1a4e-4e29-92d7-af206c25966a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.164052 Sep 12 11:54:48.140063 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 158/315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:47 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:48.181422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:48.189833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc62bb44-ea98-4580-935a-b3da5b00c768 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.168108 Sep 12 11:54:48.190389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 158/316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:48 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:48.481816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:48.482419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:48.488700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.489194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.489660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.490366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.490854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.491275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.628555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:48.636636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:48.638121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:48.639256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f661d88b-54d2-4ea8-928a-1d493857d09b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.162166 Sep 12 11:54:48.639809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 159/317] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:48 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:48.970181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:48.970817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:48.976969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.977448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.977881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:48.978787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:48.979212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:48.979634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.114723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.115967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ad8e11c-93c6-41cb-b2dd-7ecbe8407fae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.149634 Sep 12 11:54:49.116532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 159/318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:48 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:49.161204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:49.161839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:49.168641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.169238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.169682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.170364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.170848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.171308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.175252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:54:49.213127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:49.213846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:49.219907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.220468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.220827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.221520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.221976 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.222401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.303237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.311961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bb3696e5-1fef-494a-8419-50618af602a3 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1314 microversion: 2.1 time: 0.154667 Sep 12 11:54:49.316354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 160/319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:49 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:49.356104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.363801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e52f2df9-8c03-4c50-a380-e5a781eef584 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.154534 Sep 12 11:54:49.364362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 160/320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:49 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:49.664422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:49.665026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:49.671594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.672074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.672507 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.673181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:49.673633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:49.674053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:49.803233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.811714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.813156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:49.814229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2e2547b8-0157-40ba-bc98-85ad63af13df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.153739 Sep 12 11:54:49.814808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 161/321] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:49 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:50.138749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:50.139359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:50.145257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.145705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.146139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.146845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.147297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.147717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.281370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.289370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea2361cc-657c-4ff0-a152-5a77aebbc378 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.154583 Sep 12 11:54:50.289939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 161/322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:50 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:50.335025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:50.335628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:50.342041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.342531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.342964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.343632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.344077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.344492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.386484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:50.387141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:50.393441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.393937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.394361 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.395324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.395763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.396362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.482609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.490751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-391c0189-f19d-4342-afb8-75e42a236e7d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1500 microversion: 2.1 time: 0.159434 Sep 12 11:54:50.491334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 162/323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:50 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:50.543188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.552212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eddfe4b3-aecb-4b49-be9d-556966a39188 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.169726 Sep 12 11:54:50.563467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 162/324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:50 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:54:50.839629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:50.840227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:50.846139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.846676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.847109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.847774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:50.848217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:50.848633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:50.986018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.994118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.995598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:50.996962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dbb1042c-56c2-4fd5-9c5d-c8c51f3036d6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1406 microversion: 2.20 time: 0.161799 Sep 12 11:54:50.997529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 163/325] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:50 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:51.313324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:51.313929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:51.320109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:51.320585 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:51.321012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:51.321684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:51.322130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:51.322583 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:51.452054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:51.460240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84c3a4ce-e730-47a9-9e8d-0ade301531a5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.150662 Sep 12 11:54:51.460812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 163/326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:51 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:51.579815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:51.580349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:51.588133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:51.588744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:51.589182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:51.589878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:51.590331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:51.590779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:51.731457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:51.739137 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-818a85a4-50e7-4d02-8a7a-f2ddf7ecea53 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.164601 Sep 12 11:54:51.739706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 164/327] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:51 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:52.023236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:52.024620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:52.035709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.036345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.036878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.037790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.038611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.039217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.217024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:52.230556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:52.235134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:52.237113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72b44735-37f5-45bb-b56b-7c1983681f64 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1597 microversion: 2.20 time: 0.219438 Sep 12 11:54:52.251118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 164/328] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:54:52 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1597 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:54:52.265346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:52.265837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:52.274169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.274693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.275390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.276513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.276977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.277576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.406638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2cfe27d3-a5f6-4052-92f7-e361a4394ceb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145975 Sep 12 11:54:52.407275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 165/329] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Sep 12 11:54:52 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:54:52.484587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:52.485202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:52.491202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.491688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.492118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.492805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.493256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.493719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.637007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:52.644523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f8ec587-14e4-41c2-b115-9cbbf42beee5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.163703 Sep 12 11:54:52.658845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 165/330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:52 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:52.765962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:52.767359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:52.773906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.774398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.775699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:52.776122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:52.776753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:52.777186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:53.118407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:53.126809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8bf01dc3-78cb-4ae0-9cee-de01e459f11c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.365224 Sep 12 11:54:53.127420 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 166/331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:52 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:53.676089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:53.676608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:53.683150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:53.683636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:53.684068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:53.684756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:53.685226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:53.685675 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:53.837903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:53.847791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-047d6905-9a37-49b2-98ce-6feb7872bef0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.175578 Sep 12 11:54:53.848430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 166/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:53 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:53.854770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:54:53.864377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:53.864852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:53.865283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:53.876179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] Creating event network-changed:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:54:53.881325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-3a92b436-8bd0-4c57-97a9-afa4a676de31 req-6ef75362-279c-464f-a037-2d6417761767 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031191 Sep 12 11:54:53.881907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 167/333] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:54:54.150026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:54.150775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:54.156742 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:54.157222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:54.157659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:54.158341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:54.158820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:54.159252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:54.291784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:54.299913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a32c4465-2350-4fed-9b65-7c723192fc18 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.153651 Sep 12 11:54:54.300489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 167/334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:54 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:54.872081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:54.872775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:54.878848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:54.879330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:54.879762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:54.880445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:54.880920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:54.881343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:55.028379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:55.035943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af1877f2-1c9b-4827-a295-66c60c6618ae tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.168515 Sep 12 11:54:55.036552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 168/335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:54 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:55.323661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:55.324179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:55.330074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:55.330582 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:55.331018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:55.331701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:55.332151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:55.332569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:55.467702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:55.475404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a45505d-b0de-4668-82f4-848f437aa942 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156762 Sep 12 11:54:55.475975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 168/336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:55 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:56.059889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:56.060495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:56.066301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:56.066803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:56.067231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:56.067912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:56.068355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:56.068766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:56.200898 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:56.208402 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b8f10d8-969d-4d66-ab7b-f634282e9112 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.152323 Sep 12 11:54:56.208984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 169/337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:56 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:56.498419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:56.499113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:56.505233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:56.505734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:56.506202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:56.506923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:56.507376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:56.507815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:56.638882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:56.646385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11270963-aec0-4187-9657-33f6c6caf9e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.152556 Sep 12 11:54:56.647030 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 169/338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:56 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:57.231773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:57.232367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:57.238226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:57.238764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:57.239197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:57.239864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:57.240312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:57.240725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:57.368637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:57.376555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0b73b792-39c8-42b0-9f32-64cf153c0122 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.148614 Sep 12 11:54:57.377119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 170/339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:57 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:57.669665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:57.670198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:57.676095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:57.676569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:57.677000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:57.677676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:57.678229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:57.678681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:57.806671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:57.814804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b44b5207-5a4d-4df5-8385-b7cca00e7e22 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.149071 Sep 12 11:54:57.815358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:57 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:58.399984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:58.400585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:58.407052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:58.407528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:58.407954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:58.408625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:58.409069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:58.409483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:58.538246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:58.546272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd224b65-0b9d-4d7c-82cc-66dcc84b1894 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.150087 Sep 12 11:54:58.546858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 171/341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:58 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:58.838209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:58.839393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:58.845866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:58.846339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:58.846800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:58.847472 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:58.847916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:58.848330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:58.982955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:58.990629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e19b5ffd-a484-47ce-a0c6-cdd6b7840ed6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.156182 Sep 12 11:54:58.991196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 171/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:58 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:54:59.568323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:54:59.569021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:54:59.576213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:59.576775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:59.577289 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:59.578057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:54:59.578718 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:54:59.579182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:54:59.817275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:54:59.826283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e4b4aa40-776f-4086-80a0-3d6c858ea46c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.261707 Sep 12 11:54:59.826881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 172/343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:54:59 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:00.013677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:00.014293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:00.020232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.020715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.021154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.021836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.022294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.022747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.040666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:00.154932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:00.162375 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39059bf3-85e6-4ab1-a533-b84f371994ce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.153569 Sep 12 11:55:00.162946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:00 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:00.331631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a1af0a-0264-40e5-bb56-7eb32818a4dd"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:00.334028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:00.339992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.340459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.340886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.341554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.341999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.342410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.848992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:00.849601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:00.855508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.856673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.857339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.858050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:00.858507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:00.859031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:00.988901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:00.996380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd0d9905-a6aa-4fc8-94cd-e45ab08c9e6a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.151197 Sep 12 11:55:00.999775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:00 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:01.185713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:01.186353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:01.192379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:01.192907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:01.193266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:01.193939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:01.194386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:01.195087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:01.426803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:01.441769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a64856a-abed-4c5a-b5d1-ea517a4e9d98 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1367 microversion: 2.1 time: 0.255520 Sep 12 11:55:01.442936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 174/346] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:01 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:02.019277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:02.020108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:02.030704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.031216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.031651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.032587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.033008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.033400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.237258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:02.247105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a2667fd-cfaa-4abb-b115-45a86b455c68 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1321 microversion: 2.1 time: 0.231318 Sep 12 11:55:02.259930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 175/347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:02 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:02.469232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:02.470326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:02.477618 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.478315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.478843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.479535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.479986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.480407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.652010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:02.660585 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b679f4b-8293-4cf7-9d42-e94fff49a2e6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1558 microversion: 2.1 time: 0.196207 Sep 12 11:55:02.661482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 176/348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:02 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:02.683850 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:02.684576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:02.690497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.691007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.691443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.692133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:02.692585 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:02.693397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:02.812769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-172415aa-119d-4c49-9a4d-1111b8e528db tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132780 Sep 12 11:55:02.818434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 177/349] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 11:55:02 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:55:03.158451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e34a0728-273a-4c85-be33-9e058ec3d5ad tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "POST /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.830508 Sep 12 11:55:03.159092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 173/350] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:55:00 2022] POST /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a/os-volume_attachments => generated 194 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:03.273376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:03.274083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:03.280293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.280845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.281288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:03.281969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.282615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.283213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:03.473383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:03.491723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10823086-9563-475b-b77c-cd8f6e378d12 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1515 microversion: 2.1 time: 0.222217 Sep 12 11:55:03.492306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 178/351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:03 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:03.519721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:03.522672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:03.534752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.535733 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.536340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:03.537208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.537831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.538888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:03.582322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lazy-loading 'flavor' on Instance uuid 635b3409-f52c-4b47-85ed-dec792d0bd8d {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:55:03.691070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:03.722152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-306f4f8a-b571-445b-966c-a5ffb5ac3c54 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d/action" status: 200 len: 32 microversion: 2.1 time: 0.207870 Sep 12 11:55:03.723594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 174/352] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:55:03 2022] POST /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 11:55:03.733073 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:03.733834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:03.754285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.756815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.757258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:03.759933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:03.764997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:03.765934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:04.040805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2d709d-f003-488e-9bb0-bfb75d0f69ab", "tag": "b25efa2e-fad4-493f-9130-67c7da820a60"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:04.053047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:04.053817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:04.054699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:04.055623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:04.066357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09e6e02e-f646-4612-bd52-ca1674bfb1de tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.337534 Sep 12 11:55:04.070369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] Creating event network-changed:b25efa2e-fad4-493f-9130-67c7da820a60 for instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab on hv-cinder-85331 Sep 12 11:55:04.076985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-5b5ccc13-aad7-4170-ace5-a661486f32e1 req-c006f29f-bd38-4230-a31d-dc529452c8b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040637 Sep 12 11:55:04.080118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 175/353] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:04.090698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 179/354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:03 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:05.098816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:05.099696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:05.130799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:05.136072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:05.139179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:05.140117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:05.143840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:05.148672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:05.539699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:05.554268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-012b63dc-65f5-4459-9dcd-65ecb2f9bac5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.462309 Sep 12 11:55:05.566695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 176/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:05 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:06.581347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:06.582604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:06.593644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:06.596481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:06.596626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:06.597349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:06.597782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:06.598202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:06.850828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:06.859034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59ae9a05-36b8-4229-b000-1c4cdce92892 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.283210 Sep 12 11:55:06.859598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 180/356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:06 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:07.882798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:07.883328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:07.885916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=73 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:07.891958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:07.892763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:07.893331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:07.894167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:07.894649 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:07.895071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:08.025132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:08.033131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-95fc3792-fe1a-4d12-af8b-39732ce16fd7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.154262 Sep 12 11:55:08.033693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 177/357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:07 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:09.056309 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:09.056918 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:09.059554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=86 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:09.065182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:09.065712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:09.066148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:09.066861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:09.067316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:09.067738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:09.203647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:09.211217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b2f732b-6272-4685-b0be-3e9e4a03ecc6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.159398 Sep 12 11:55:09.211773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 181/358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:09 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:10.234222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:10.234828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:10.241188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:10.241659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:10.242086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:10.242785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:10.243232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:10.243652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:10.370780 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:10.378578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ab743065-9995-4de0-a55e-88e73ac83d3d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.148734 Sep 12 11:55:10.379084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 178/359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:10 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:11.401749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:11.402751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:11.408973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:11.409445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:11.409869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:11.410567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:11.411016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:11.411436 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:11.536671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:11.544617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de6e375b-4180-4c0c-b962-dbf56b81e953 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.147018 Sep 12 11:55:11.545170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 182/360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:11 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:12.567784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:12.568421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:12.575436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:12.575597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:12.576065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:12.576753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:12.577206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:12.577629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:12.707705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:12.716566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4e8a205-fd2c-4b93-8d53-94cf79ca378a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.152605 Sep 12 11:55:12.717131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 179/361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:12 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:13.738803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:13.739418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:13.745514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:13.746598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:13.747145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:13.747973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:13.748397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:13.748825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:13.881142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:13.888746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3298d63-e583-421c-89d4-b08eff3bc2db tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.153729 Sep 12 11:55:13.889289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 183/362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:13 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:14.910814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:14.911414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:14.917803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:14.918288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:14.918734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:14.919407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:14.919853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:14.920268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:15.052881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:15.061040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e560e10a-4707-4a5c-bb8d-d9c0e8b05738 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.154110 Sep 12 11:55:15.061614 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 180/363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:14 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:16.083387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:16.083997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:16.089966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:16.090382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:16.090914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:16.091523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:16.091969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:16.092388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:16.229489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:16.238326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b0680aaf-9a77-4ad5-8a4f-d24acf245937 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.158670 Sep 12 11:55:16.239017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 184/364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:16 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:17.209972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:17.210595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:17.217460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.217943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.218882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.219635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.220085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.220505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.267689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:17.267689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:17.275059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.275646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.276153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.276933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.277484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.278156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.385888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:55:17.416311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:17.425485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9a87456-58c6-414d-940c-ef222fbb96e8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.165345 Sep 12 11:55:17.426081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 185/365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:17 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:17.469896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bdd650e-a094-41ef-aac2-4e68542a299c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 204 len: 0 microversion: 2.1 time: 0.269788 Sep 12 11:55:17.470588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 181/366] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:55:17 2022] DELETE /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:55:17.479167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:17.479895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:17.486530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.487032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.487491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.488177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:17.488639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:17.489057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:17.620452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:17.629322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf3d7284-89ed-4264-b6b3-53e9c5f3e971 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.154223 Sep 12 11:55:17.629881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 186/367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:17 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:18.448986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:18.450846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:18.457616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:18.458089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:18.458533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:18.459213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:18.459658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:18.460074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:18.594836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:18.602392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-629f4f17-e0d3-4be5-873e-2a8daefb89bd tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.157565 Sep 12 11:55:18.602967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 182/368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:18 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:18.651638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:18.652241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:18.658836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:18.659380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:18.659816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:18.660539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:18.660992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:18.661415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:18.799193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:18.809266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d64705c-ca70-4ce3-9aff-8348cbfba945 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.161334 Sep 12 11:55:18.810327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 187/369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:18 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:19.626827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:19.627449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:19.633892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:19.634374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:19.634843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:19.635531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:19.635990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:19.636411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:19.770014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:19.777664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f71365f4-5f2a-4310-9081-c8a1c0e0fdcb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.154662 Sep 12 11:55:19.778256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 183/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:19 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:19.838335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:19.838964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:19.845177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:19.845724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:19.846219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:19.847010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:19.847526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:19.848013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:19.980728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:19.989474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a02c489b-4ff0-4723-94c9-a8574569d0a5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.155047 Sep 12 11:55:19.990038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 188/371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:19 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:20.800668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:20.801286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:20.807808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:20.808292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:20.808729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:20.809456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:20.809920 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:20.810349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:20.945965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:20.952792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-80087373-a53c-4e93-94ad-4bee08b4a74b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.155903 Sep 12 11:55:20.953453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 184/372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:20 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:21.013584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:21.014287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:21.020148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:21.020625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:21.021053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:21.021726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:21.022174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:21.022619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:21.041054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:21.163838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:21.174649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96658340-0684-44f2-b9f4-46e4e98c3a46 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.165875 Sep 12 11:55:21.175228 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 189/373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:21 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:21.975557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:21.976169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:21.983275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:21.983762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:21.984200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:21.984888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:21.985349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:21.985777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:22.114215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:22.123570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-15893db7-9b12-4658-9a43-4eac9a5bff66 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.151840 Sep 12 11:55:22.124194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 185/374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:21 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:22.197648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:22.198310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:22.204500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:22.204980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:22.205411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:22.206092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:22.206568 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:22.206994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:22.341799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:22.349723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10b020e7-6cc6-4090-81cf-66d5b167a9d5 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.156150 Sep 12 11:55:22.350277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 190/375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:22 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:23.146325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:23.146958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:23.153462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:23.153941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:23.154374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:23.155080 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:23.155531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:23.155981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:23.288041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:23.297306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dca41d16-7c3b-49c8-bf32-d6be33bebb4f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.154736 Sep 12 11:55:23.297958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 186/376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:23 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:23.373655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:23.374292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:23.380427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:23.380906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:23.381338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:23.382015 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:23.382465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:23.382967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:23.516388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:23.524704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15e665df-cdcb-45c5-8bdb-69317a125aee tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1552 microversion: 2.1 time: 0.155860 Sep 12 11:55:23.525264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 191/377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:23 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:24.321454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:24.322058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:24.328554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:24.329032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:24.329458 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:24.330212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:24.330706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:24.331126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:24.502078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea7ece5-4d6f-4665-9921-916f547c633a", "name": "network-vif-deleted", "tag": "36f5b056-844b-43e1-a1c7-eefdca3b6f3d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:24.512169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:24.512628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:24.513913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:24.530545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] Creating event network-vif-deleted:36f5b056-844b-43e1-a1c7-eefdca3b6f3d for instance 5ea7ece5-4d6f-4665-9921-916f547c633a on hv-cinder-85331 Sep 12 11:55:24.536070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-066b2e0d-ffb0-44d0-82db-98a191e3207c req-de16b823-bff2-4142-99d8-6718f29a1b2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039828 Sep 12 11:55:24.537004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 192/378] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:24.551607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:24.552796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:24.562672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:24.563171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:24.563607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:24.564314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:24.564767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:24.565387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:24.571017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:24.586363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c382ae93-b88c-48eb-8bfe-4b5da7312710 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.268922 Sep 12 11:55:24.589345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 187/379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:24 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:24.657424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:24.666524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27eb3a4f-8354-49d5-a6eb-0d6f0eeeee2c tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1345 microversion: 2.1 time: 0.120755 Sep 12 11:55:24.667419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 193/380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:24 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:25.611115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:25.611799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:25.618168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:25.618683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:25.619120 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:25.619950 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:25.620396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:25.620927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:25.689161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:25.689925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:25.696958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:25.697540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:25.698188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:25.699016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:25.699674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:25.700934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:25.773280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:25.775573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:25.782157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e70c06de-46a4-4d45-afa3-17b43717170c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.174820 Sep 12 11:55:25.782935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 188/381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:25 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:25.785099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f7fe6a2-340d-4265-a27c-a272c8faa83d tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1345 microversion: 2.1 time: 0.099707 Sep 12 11:55:25.785890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 194/382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:25 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:26.805434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:26.806545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:26.807257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:26.807971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:26.812859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:26.813344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:26.813776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:26.814614 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:26.815153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:26.815314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:26.815495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:26.815862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:26.816364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:26.817124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:26.817645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:26.818159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:26.882404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:26.897825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a468d4c-bb92-462b-9528-79c07dc3d147 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1345 microversion: 2.1 time: 0.094384 Sep 12 11:55:26.906994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 195/383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:26 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:26.963029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:26.971448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7cf23ef5-1641-4e13-b514-a438da66a2be tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.170014 Sep 12 11:55:26.972014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 189/384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:26 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:27.922793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:27.923409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:27.929310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:27.929792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:27.930227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:27.930935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:27.931396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:27.931822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:27.994996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:27.995514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23126c9640d6433e96d393b885f3f829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b68484aca102406a914066e2cc11a452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:27.995645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:28.002408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:28.002917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:28.003352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:28.004047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:28.004501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:28.004672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88a26db3-4f33-4386-a89e-8fa1eb50cb8a tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 200 len: 1345 microversion: 2.1 time: 0.086069 Sep 12 11:55:28.004921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:28.006949 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 196/385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:27 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:28.011612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:28.167049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:28.178574 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8105f8ef-d9e9-4b1c-bc09-de757bc0ce04 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.186902 Sep 12 11:55:28.179680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 190/386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:27 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:29.027790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:29.029229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:29.036139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.036556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.036988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.037677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.038133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.038877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.052787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] HTTP exception thrown: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Request method failure captured: Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a HTTP/1.1 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2qw1YMlxzJO9CZt0VK37i0Fmt4BTWzTlBHzdn-OKITRy3COiJknapLQmI8uTC4Zx7Aen3hF4m2WPHMnpgWSOvJVMmwbu0kKXPRHr7xfcqu6HfU05KeYcRPmDtLjn_TlE9dc0w1cvRw7ByEgODZ7x9iMqvlAsgmK8XyoUDtezCbPyE Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:55:29.057354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b68484aca102406a914066e2cc11a452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b68484aca102406a914066e2cc11a452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}] Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 23126c9640d6433e96d393b885f3f829 Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.058886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '5ea7ece5-4d6f-4665-9921-916f547c633a'} Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:55:29.059865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.061277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.062401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Returning 404 to user: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:55:29.062401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27f2f2cb-3f00-482b-b653-5b1a4fa1bab4 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 404 len: 111 microversion: 2.1 time: 0.034840 Sep 12 11:55:29.062401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 197/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:29 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:55:29.212225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:29.213085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:29.214101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:29.220117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:29.228088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.228666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.228994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.231263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.232460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.233236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.233922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.234184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.235042 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.242755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:29.242755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:29.243268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:29.273735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] HTTP exception thrown: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Request method failure captured: Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a/os-volume_attachments HTTP/1.1 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2qw1YMlxzJO9CZt0VK37i0Fmt4BTWzTlBHzdn-OKITRy3COiJknapLQmI8uTC4Zx7Aen3hF4m2WPHMnpgWSOvJVMmwbu0kKXPRHr7xfcqu6HfU05KeYcRPmDtLjn_TlE9dc0w1cvRw7ByEgODZ7x9iMqvlAsgmK8XyoUDtezCbPyE Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:55:29.281006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b68484aca102406a914066e2cc11a452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b68484aca102406a914066e2cc11a452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}] Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 23126c9640d6433e96d393b885f3f829 Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.282541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'server_id': '5ea7ece5-4d6f-4665-9921-916f547c633a'} Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:55:29.283230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:29.284364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:29.285472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Returning 404 to user: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:55:29.285472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e1f1f65f-eced-4358-8548-e52b962d4bfe tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079838 Sep 12 11:55:29.285472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 191/388] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 11:55:29 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a/os-volume_attachments => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:55:29.413952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:29.426362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f82dae3-23b1-41db-b78b-c936f1a2ffdf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.221244 Sep 12 11:55:29.427454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 198/389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:29 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:30.449927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:30.450726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:30.457009 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:30.457466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:30.457892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:30.458598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:30.459047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:30.459557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:30.601953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:30.611260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8d136506-30a9-4470-9b26-62f80c9d8dc2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.165316 Sep 12 11:55:30.612228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 192/390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:30 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:31.637423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:31.638039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:31.645113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.645113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.645113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.646053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.646299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.646623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.785205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:31.794276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ff09fd1-ce75-4286-a6be-468075409adc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.159941 Sep 12 11:55:31.795143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 199/391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:31 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:31.820686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:31.821759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:31.828691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.829235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.829701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.830340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.830821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.831238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.844761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] HTTP exception thrown: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Request method failure captured: Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a HTTP/1.1 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2qw1YMlxzJO9CZt0VK37i0Fmt4BTWzTlBHzdn-OKITRy3COiJknapLQmI8uTC4Zx7Aen3hF4m2WPHMnpgWSOvJVMmwbu0kKXPRHr7xfcqu6HfU05KeYcRPmDtLjn_TlE9dc0w1cvRw7ByEgODZ7x9iMqvlAsgmK8XyoUDtezCbPyE Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:55:31.846932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b68484aca102406a914066e2cc11a452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b68484aca102406a914066e2cc11a452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}] Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 23126c9640d6433e96d393b885f3f829 Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.848400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '5ea7ece5-4d6f-4665-9921-916f547c633a'} Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:55:31.849126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.850280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.851714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Returning 404 to user: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:55:31.851714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6b44689d-7c2d-4b77-ae1a-cb15fc160290 tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 404 len: 111 microversion: 2.1 time: 0.031923 Sep 12 11:55:31.851714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 193/392] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:55:31 2022] DELETE /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:55:31.858077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:31.859265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] [instance: 5ea7ece5-4d6f-4665-9921-916f547c633a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:31.865243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.865724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.866152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.866868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:31.867321 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:31.867744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:31.881757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] HTTP exception thrown: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Request method failure captured: Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a HTTP/1.1 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2qw1YMlxzJO9CZt0VK37i0Fmt4BTWzTlBHzdn-OKITRy3COiJknapLQmI8uTC4Zx7Aen3hF4m2WPHMnpgWSOvJVMmwbu0kKXPRHr7xfcqu6HfU05KeYcRPmDtLjn_TlE9dc0w1cvRw7ByEgODZ7x9iMqvlAsgmK8XyoUDtezCbPyE Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:55:31.883627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b68484aca102406a914066e2cc11a452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b68484aca102406a914066e2cc11a452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b68484aca102406a914066e2cc11a452"}]}] Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: b68484aca102406a914066e2cc11a452 Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889912999 Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 23126c9640d6433e96d393b885f3f829 Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-1889912999-project Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.885026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '5ea7ece5-4d6f-4665-9921-916f547c633a'} Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:55:31.885856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. Sep 12 11:55:31.886990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:55:31.888935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] Returning 404 to user: Instance 5ea7ece5-4d6f-4665-9921-916f547c633a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:55:31.888935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bd5edfe-c7c9-4704-97e3-f3f6f0135eab tempest-DeleteServersTestJSON-1889912999 tempest-DeleteServersTestJSON-1889912999-project] 10.222.0.15 "GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a" status: 404 len: 111 microversion: 2.1 time: 0.031473 Sep 12 11:55:31.888935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 200/393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:31 2022] GET /compute/v2.1/servers/5ea7ece5-4d6f-4665-9921-916f547c633a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 11:55:32.817821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:32.818772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:32.825734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:32.826359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:32.826671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:32.827357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:32.827806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:32.828227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:33.340312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:33.355632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-644bbe4c-5e70-4c71-a004-1552093e2b2b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.540567 Sep 12 11:55:33.357287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 194/394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:32 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:34.380430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:34.381170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:34.388513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:34.389136 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:34.389570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:34.390257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:34.390729 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:34.391149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:34.546065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:34.556453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d40444e-4a27-40e9-a16f-60677ff311af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.180149 Sep 12 11:55:34.557492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 201/395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:34 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:35.584467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:35.585081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:35.591484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:35.591967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:35.592399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:35.593101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:35.593586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:35.594008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:35.900875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:35.910500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eef9c221-d47e-4558-bdd0-185f13d8d700 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.334477 Sep 12 11:55:35.914940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 195/396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:35 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:36.933315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:36.933917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:36.945177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:36.945177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:36.945177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:36.945177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:36.945500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:36.945500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:37.121000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:37.129886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d98f20c7-4a65-47c3-807a-963d089791b5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.200477 Sep 12 11:55:37.130445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 202/397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:36 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:38.153433 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:38.154192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:38.158604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:38.163632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:38.164244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:38.164857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:38.165553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:38.166005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:38.166624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:38.320285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:38.329959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ca868b36-7adf-41df-9a60-76cc5e276efc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.180387 Sep 12 11:55:38.330990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 196/398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:38 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:39.354732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:39.355940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:39.362216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=44 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:39.364146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:39.364790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:39.374121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:39.375211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:39.387391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:39.388389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:39.541133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:39.551644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2043244d-a9a9-44c8-bf72-10122d81f20c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.201685 Sep 12 11:55:39.553240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 203/399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:39 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:40.577279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:40.578580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:40.585927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:40.586824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:40.587505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:40.588445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:40.589171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:40.589873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:40.821272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:40.833055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c72c7a90-603f-48e8-9c29-bcdf9659cc56 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.260561 Sep 12 11:55:40.834970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 197/400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:40 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:41.712900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c69c36b7-fc6d-49ac-a1e9-352c2c358da1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: .version_select at 0x7fc93a523ee0>, body: {"keypair": {"name": "tempest-keypair-30101850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpmltcc6P5U7g1ioQm7ZMKfPAYPG37wEf0LJlt1IcR113H1tQP/5B5/z6aL71iKNVGTQkt9KyLnP36JlIUyKzfrg+yregzPeEZpTJpmm5iXsdtaAioS02YG55aTrbRsvA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:41.728945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-c69c36b7-fc6d-49ac-a1e9-352c2c358da1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:55:41.733588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-c69c36b7-fc6d-49ac-a1e9-352c2c358da1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for user 16e5bc69062549e5bebb5b33e1be492e and project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:55:41.757784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c69c36b7-fc6d-49ac-a1e9-352c2c358da1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.164936 Sep 12 11:55:41.758381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 204/401] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 11:55:41 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:41.859477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:41.860151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:41.866990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:41.867477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:41.867914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:41.868682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:41.869060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:41.869510 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:42.074785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:42.083393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-97b73f97-019a-4c15-acb1-643f0cbce3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.228311 Sep 12 11:55:42.083967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 198/402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:41 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:42.633166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1006729031", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "networks": [{"uuid": "190ca13d-23a4-4727-abc0-c0a3ec2ef0b1"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:42.693545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] validate_networks() for [('190ca13d-23a4-4727-abc0-c0a3ec2ef0b1', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:55:43.111103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:43.112244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:43.120122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:43.121253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:43.121902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:43.122782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:43.123386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:43.123968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:43.298669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:43.315266 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-034a18b2-316a-42d5-8a61-7c23d59ccadb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.208344 Sep 12 11:55:43.328413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 199/403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:43 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:43.386702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:55:43.388450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:55:43.389255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:55:43.389976 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:55:43.391289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:55:43.406796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:43.408001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:43.408853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:43.409809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:43.410619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:43.411256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:43.435575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Getting quotas for project ad01763b3d76492598530234d3b75ec8. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:55:43.440700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Getting quotas for user f4b71a4e5c1a4656a541f9cacec0af18 and project ad01763b3d76492598530234d3b75ec8. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:55:43.449768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1428951427", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8119da17-2877-4086-aa22-ceb6305c044c"}], "security_groups": [{"name": "tempest-securitygroup--1712486552"}], "key_name": "tempest-keypair-30101850", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:43.455098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:55:43.457824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:55:43.533899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ec12bf3-eb2d-48eb-b13a-536822b3407b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904436 Sep 12 11:55:43.535203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 205/404] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:55:43.549565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c3006e4-d888-49e2-8771-1d604c9cb1f1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:43.551873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c3006e4-d888-49e2-8771-1d604c9cb1f1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:43.661491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c3006e4-d888-49e2-8771-1d604c9cb1f1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:43.676072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c3006e4-d888-49e2-8771-1d604c9cb1f1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1219 microversion: 2.1 time: 0.133749 Sep 12 11:55:43.684058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] validate_networks() for [('8119da17-2877-4086-aa22-ceb6305c044c', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:55:43.693811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 206/405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:43 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:44.252405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:55:44.253031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:55:44.253633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:55:44.254173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:55:44.254806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:55:44.268478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.268955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.269381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.270213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.270708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.271318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.288676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:55:44.296968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for user 16e5bc69062549e5bebb5b33e1be492e and project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:55:44.309047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:55:44.312032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:55:44.340071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:44.342202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:44.348646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.349176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.349656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.350450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.350997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.351483 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.381019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-71271323-b3db-4a25-9d43-1acf152013e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.936484 Sep 12 11:55:44.386942 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 200/406] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:55:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 11:55:44.393708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-34dfbf92-1764-4c99-b5fd-c243de7764e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:44.394444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-34dfbf92-1764-4c99-b5fd-c243de7764e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:44.499016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-34dfbf92-1764-4c99-b5fd-c243de7764e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:44.508745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-34dfbf92-1764-4c99-b5fd-c243de7764e2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1236 microversion: 2.1 time: 0.118479 Sep 12 11:55:44.509604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 201/407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:44 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:44.528897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:44.536691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e338b96f-588f-4ca6-bd25-160f044f490f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.201457 Sep 12 11:55:44.537273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 207/408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:44 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:44.701290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:44.702011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:44.708938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.709719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.710190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.710983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:44.711646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:44.712101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:44.797057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:44.812996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cc520e17-ad84-4ced-93b9-184216191ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1223 microversion: 2.1 time: 0.116112 Sep 12 11:55:44.813802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 202/409] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:44 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:45.534261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:45.536692 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:45.544298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.545124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.545754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.549322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.550164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.550784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.563302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:45.564963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:45.582812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.584158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.586160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.588935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.590109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.592666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.682599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:45.692150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2a28ae4-4aec-4e05-b4c1-0ce3f3d369d8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1232 microversion: 2.1 time: 0.162595 Sep 12 11:55:45.692746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 208/410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:45 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1232 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:45.837751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:45.837995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:45.838377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:45.845493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.847718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.848318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.849373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:45.849950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:45.850054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-26f8a4fb-6fc3-4d55-96f1-3ec99e8919cb tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.292569 Sep 12 11:55:45.850570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:45.863004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 203/411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:45 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:45.945054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:45.954383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a614d57f-e730-438b-9a1a-86dd1e8601c5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1271 microversion: 2.1 time: 0.121501 Sep 12 11:55:45.955344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 209/412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:45 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:46.716894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:46.717505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:46.724486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:46.724968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:46.725406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:46.726087 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:46.726560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:46.726985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:46.818383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:46.830996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-188ece17-1608-4d4a-9b1b-5f22360716c2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1232 microversion: 2.1 time: 0.117942 Sep 12 11:55:46.832724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 204/413] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:46 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1232 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:46.878386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:46.879227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:46.885609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:46.886096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:46.886745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:46.887980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:46.888456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:46.889084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:46.984276 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:46.988235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:47.004977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:47.005634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:47.006793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:47.011254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:47.013109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:47.013767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:47.141578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:47.155844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6d190af9-951e-40b1-8b05-85eae1156288 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1279 microversion: 2.1 time: 0.177588 Sep 12 11:55:47.157344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 205/414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:46 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:47.328369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:47.331683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:47.337775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4817afec-0cb0-4fba-84a4-9ebd45a417b3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1521 microversion: 2.1 time: 0.463156 Sep 12 11:55:47.343895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 210/415] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:46 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:47.855469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:47.856077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:47.862748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:47.863235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:47.864233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:47.864935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:47.865393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:47.865819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:47.943820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:47.954505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b9b887f3-dbb1-481c-be7f-cb4256853e8c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1288 microversion: 2.1 time: 0.102899 Sep 12 11:55:47.955435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 206/416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:47 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:48.182165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:48.183409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:48.190926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.191950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.192689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.194465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.195337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.196655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.364020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:48.370165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:48.393538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.394621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.395986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.398587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.399151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.400615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.402762 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:48.417783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-132b8878-2c93-4b2e-ae71-a32d13be9238 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1277 microversion: 2.1 time: 0.239795 Sep 12 11:55:48.431511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 211/417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:48 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:48.753514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:48.766402 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-14fc7e3e-cd02-422f-940b-4ed19d5bcec4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1501 microversion: 2.1 time: 0.406397 Sep 12 11:55:48.767815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 207/418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:48 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1501 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:48.792484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:48.793094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:48.799733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.800526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.801421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.802495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.803126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.803883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.981666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:48.984486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:48.995747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.996520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:48.997664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:48.998759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:48.999469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:49.000098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:49.093484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:49.118378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-18f2f855-b89a-4389-915f-025b262866c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1294 microversion: 2.1 time: 0.142638 Sep 12 11:55:49.119003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 208/419] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:48 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:49.176141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:49.192591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c15f34cf-c66b-48fd-970f-6f0e7a4a2928 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1516 microversion: 2.1 time: 0.402622 Sep 12 11:55:49.194892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 212/420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:48 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:49.446321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:49.448121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:49.461344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:49.462209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:49.462875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:49.466356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:49.466356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:49.466356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:49.692009 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:49.696222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:49.705990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9fdd737d-60bd-4843-82ad-d309345f54e8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.265311 Sep 12 11:55:49.719305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 209/421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:49 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:50.145555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:50.146289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:50.162554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.162554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.162554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:50.162554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.163775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.164612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:50.470048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:50.482236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aac632b-8dea-4d13-9ce4-2fecd7dc1f90 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.342101 Sep 12 11:55:50.494772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 213/422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:50 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:50.736070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:50.737262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:50.745730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.747559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.748119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:50.748928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.749511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.750071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:50.962581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:50.965245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:50.973103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.973982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.974730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:50.975963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:50.976785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:50.978447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.009644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lazy-loading 'flavor' on Instance uuid 4310e71e-de3e-4855-8800-8bb60f9d8428 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:55:51.184821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:51.196467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f6a2e709-2eee-4e0c-ada7-f0e28eb69ac1 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.469253 Sep 12 11:55:51.201998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 210/423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:50 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:51.220573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0091a504-f12a-4e6c-81fa-fbffd4805e6c", "tag": "97caae66-7f53-4c32-88b7-4710eddd6d85"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:51.241520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.242028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.243910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.279367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] Creating event network-changed:97caae66-7f53-4c32-88b7-4710eddd6d85 for instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c on hv-cinder-85331 Sep 12 11:55:51.292316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-2683eaf6-51c3-4a07-8d8c-fb30098c886c req-fee72843-e648-477f-ba6c-d435b4f209b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087909 Sep 12 11:55:51.294785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 211/424] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:51.301716 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bff9ca9-92fa-4ad9-867f-4f889d1261bc", "tag": "1f7a6854-4f86-4255-8146-a2403a0437ef"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:51.322868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.327444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.328313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.357995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] Creating event network-changed:1f7a6854-4f86-4255-8146-a2403a0437ef for instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc on hv-cinder-85331 Sep 12 11:55:51.364845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-9a93d4f3-4b1c-4028-b876-cb62259af377 req-32d69b4e-21bd-4f11-853c-65f9246cf0fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067803 Sep 12 11:55:51.365855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 212/425] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:55:51.397655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71c1b4e7-e5e8-45be-8206-ea35d25f0397 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/action" status: 200 len: 32 microversion: 2.1 time: 0.437932 Sep 12 11:55:51.403564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 214/426] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:55:50 2022] POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 12 11:55:51.415937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:51.416678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:51.439538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.444173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.444654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.446049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.446741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.447180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.511142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:51.511924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:51.520017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.520721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.521315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.522164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:51.522796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:51.523368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:51.705398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:51.717432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8fd1c3a4-8f7a-466e-a1bb-5d15810609ad tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.311737 Sep 12 11:55:51.718442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 213/427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:51 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:52.158327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:52.165968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7abe08a-5e3e-4aa1-9dff-94ed4d795e57 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.660750 Sep 12 11:55:52.166554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 215/428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:51 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:52.230665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:52.232297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:52.247472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:52.248061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:52.249080 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:52.251621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:52.253053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:52.253717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:52.468925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:52.477116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-97073b50-5139-459f-9c2d-39ad9b861c19 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.252318 Sep 12 11:55:52.478237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 214/429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:52 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:52.745187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:52.745955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:52.753019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:52.753831 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:52.755288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:52.756404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:52.758864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:52.758864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:53.047740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:53.064196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4f34d18-211b-48de-a357-b429fd754208 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.322598 Sep 12 11:55:53.065587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 216/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:52 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:53.194227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:53.194962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:53.204139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:53.204979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:53.206159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:53.207105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:53.207729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:53.208165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:53.400908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:53.415496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b68be333-afb1-4d5a-9ae9-d096a0792a39 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.225337 Sep 12 11:55:53.416090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 215/431] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:53 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:53.498333 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:53.504181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:53.505020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:53.521256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:53.522045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:53.523167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:53.524863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:53.525602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:53.526377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:53.666699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:53.695196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:53.705221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ba50f7c-218b-45a8-91fe-5404fb3eee5f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.208560 Sep 12 11:55:53.706134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 217/432] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:53 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:54.089655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:54.091086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:54.099991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.100484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.100917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:54.101668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.102183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.102637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:54.279086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:54.371446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:54.385412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1ff4f426-7c17-41e9-8693-7d6e88df60a6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.299877 Sep 12 11:55:54.388293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 216/433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:54 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:54.443748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:54.444729 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:54.453094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.453596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.454037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:54.454763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.455224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.455653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:54.728514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:54.729796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:54.732844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=8 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:55:54.746504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.757026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.757543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:54.758404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:54.758927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:54.759379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:55.012892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:55.024226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e2b6f2e9-d6fb-4924-89ab-7fa7660066ad tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.299486 Sep 12 11:55:55.024843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 217/434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:54 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:55.056722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:55.068116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0b9b824-af59-4c2a-bba0-f1b491695c00 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.627483 Sep 12 11:55:55.091905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 218/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:54 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:55.422046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:55.424542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:55.431933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:55.432068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:55.432483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:55.433609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:55.435581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:55.436289 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:55.636195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:55.646435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-00569415-142f-4a87-ac64-2ca4ed2d64b6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.228159 Sep 12 11:55:55.647155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 218/436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:55 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:56.051053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:56.053405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:56.062196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.062853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.063496 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.065230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.065678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.066263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.097174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:56.098537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:56.108633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.109366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.116078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.119886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.120570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.125218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.291627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:56.304516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90876a5d-2833-4a28-90e3-7334a65906d5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.210634 Sep 12 11:55:56.305980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 219/437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:56 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:56.313079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1048166034", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "networks": [{"uuid": "2facb9c9-2860-46c3-a7a5-51de9d3fd301"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:55:56.353619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:56.363308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2502002-dff5-4e18-8b03-cdc1115e9431 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.316541 Sep 12 11:55:56.369482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 219/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:56 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:56.392091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] validate_networks() for [('2facb9c9-2860-46c3-a7a5-51de9d3fd301', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:55:56.669599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:56.670218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:56.677904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.678465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.679554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.680511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.681083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.681570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.828185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:55:56.828640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:55:56.829088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:55:56.829494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:55:56.830797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:55:56.843846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.844532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.845129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.846000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:56.846805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:56.847376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:56.867902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Getting quotas for project d01561573a044c87a4102522b8fe8432. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:55:56.873092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Getting quotas for user 5167ece674de4c11b71bb63db58f9eb3 and project d01561573a044c87a4102522b8fe8432. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:55:56.892980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:55:56.895452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:55:57.016754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7f0f92e1-968c-43d6-8468-f4919b12cb64 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708946 Sep 12 11:55:57.016916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 220/439] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:55:57.040148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-25e39886-2e61-40b4-8f69-c0e8b594d2d9 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:57.040844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-25e39886-2e61-40b4-8f69-c0e8b594d2d9 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:57.158753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25e39886-2e61-40b4-8f69-c0e8b594d2d9 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:57.159308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:57.159729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-25e39886-2e61-40b4-8f69-c0e8b594d2d9 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1214 microversion: 2.1 time: 0.130869 Sep 12 11:55:57.165407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 221/440] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:57 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:57.165886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cde8646e-1d21-41bf-b236-2282bf382857 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.500333 Sep 12 11:55:57.181430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 220/441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:56 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:57.332876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:57.333931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:57.345643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:57.346136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:57.348787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:57.349509 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:57.354449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:57.355086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:57.390971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:57.391890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:57.404125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:57.405619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:57.406135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:57.406980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:57.408887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:57.409394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:57.641995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:57.655127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f74a15ac-dca4-46e1-b104-5e78275c74ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.326721 Sep 12 11:55:57.656958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 222/442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:57 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:58.057090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:58.065824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34bd5176-bb11-4cbf-864f-717a879cdabb tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.680096 Sep 12 11:55:58.066421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 221/443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:57 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:58.187463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:58.189058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:58.195026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:58.195636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:58.201554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.202478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.203141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.203827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.204952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.205622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.206207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.209094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.209582 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.210281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.210783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.211203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.331277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:58.344085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-83298632-50c1-428a-80f8-729350a1725d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1266 microversion: 2.1 time: 0.162000 Sep 12 11:55:58.359955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 223/444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:58 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:58.601884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:58.611707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce8de008-9a76-4c58-bb54-f8f0673eb4c2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.420925 Sep 12 11:55:58.612559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 222/445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:58 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:58.681618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:58.682632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:58.696863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.697517 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.697863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.700449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:58.701075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:58.701785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:58.888468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:58.900843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8aec4d15-c805-49a2-9d10-fe2ccdf2f46e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.224700 Sep 12 11:55:58.902610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 224/446] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:58 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:59.093311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:59.094390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:59.103334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.104012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.104548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.105411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.106506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.107061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.374705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:59.378105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:59.396418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.396914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.399483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.400552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.401361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.402217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.508347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:59.520433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09cce53f-46b0-4fad-8f1c-6127f136fd4f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.434116 Sep 12 11:55:59.520804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 223/447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:59 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:55:59.570002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:55:59.578118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-54b00b15-d92e-47fd-ac90-8f3d5cb1b631 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1284 microversion: 2.1 time: 0.212794 Sep 12 11:55:59.578977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 225/448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:59 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:55:59.637949 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:59.639117 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:59.647247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.647847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.648286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.649202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.650249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.650874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.924627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:55:59.925563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:55:59.936930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.938016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.939346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:55:59.941567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:55:59.942386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:55:59.943985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:00.099998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:00.114421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d5d1129-4ec6-45da-87cd-5cfda02e32d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.478544 Sep 12 11:56:00.118318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 224/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:59 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:00.227447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:00.241136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea3db9f6-f298-4b0d-be2c-acf97cca59d0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.320315 Sep 12 11:56:00.254543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 226/450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:55:59 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:00.544257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:00.547267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:00.554051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:00.554555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:00.555252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:00.557220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:00.557960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:00.559519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:00.592431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:00.605355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:00.606300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:00.619139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:00.619549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:00.623611 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:00.625889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:00.626379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:00.626841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:00.811847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:00.826428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2f938611-782b-4ddb-9779-eaab138c9972 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.227121 Sep 12 11:56:00.830711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 227/451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:00 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:00.892255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:00.913526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa51500d-092f-4cc7-929d-1e8b9e778565 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.373115 Sep 12 11:56:00.922834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 225/452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:00 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:01.012957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bff9ca9-92fa-4ad9-867f-4f889d1261bc", "name": "network-vif-plugged", "status": "completed", "tag": "1f7a6854-4f86-4255-8146-a2403a0437ef"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:01.028372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.029715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.030838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.044774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] Creating event network-vif-plugged:1f7a6854-4f86-4255-8146-a2403a0437ef for instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc on hv-cinder-85331 Sep 12 11:56:01.070984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a9c66cdf-bf6d-4203-83b8-f338264768eb req-2210ad80-0419-4c58-afdf-0045258e0435 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045965 Sep 12 11:56:01.073765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 228/453] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:56:01.146476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:01.147400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:01.156542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.157573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.158206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.159147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.160417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.162609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.272594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:01.273388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:01.286467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:01.291206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.292070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.295431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.296355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.298041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.301669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.644338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:01.679941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f24b43db-ebca-455e-b84d-9b0ad6851132 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.524571 Sep 12 11:56:01.691388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 226/454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:01 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:01.814254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:01.830814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-375932c9-2631-4156-b7f4-f851a7079898 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.556160 Sep 12 11:56:01.830814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 229/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:01 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:01.851653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:01.852482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:01.863884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.865578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.866308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.868531 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.869987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.872314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.946629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:01.947242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:01.963272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.963272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.963272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.963580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:01.964019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:01.964454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:01.969975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:02.085071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:02.098854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bd357cd-7621-48b4-bc31-7c75806c08ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.252116 Sep 12 11:56:02.109956 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 227/456] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:01 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:02.121695 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514f5d72-078b-417b-a00c-8a48e7d7c162", "tag": "1fefe1ab-340a-42cc-ae4d-138c66b351e6"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:02.132327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:02.133223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:02.133847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:02.148908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] Creating event network-changed:1fefe1ab-340a-42cc-ae4d-138c66b351e6 for instance 514f5d72-078b-417b-a00c-8a48e7d7c162 on hv-cinder-85331 Sep 12 11:56:02.154929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3cba95b7-6265-466d-b41a-fb0177941d78 req-52c4b862-3a23-4a8d-b80b-cf0003d94e07 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043003 Sep 12 11:56:02.155953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 228/457] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:02.189600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:02.198622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3529b213-b5e8-4b68-a6bf-a214d44ba684 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.257524 Sep 12 11:56:02.200343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 230/458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:01 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:02.719927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:02.721296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:02.728536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:02.729314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:02.729964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:02.731081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:02.731839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:02.732332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:02.859106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:02.859713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:02.865928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:02.866409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:02.866885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:02.867570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:02.868022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:02.868440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.021870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:03.033014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c776f126-12fb-401c-83d2-6187ddf184c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.320485 Sep 12 11:56:03.047717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 229/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:02 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:03.126654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:03.128079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:03.138125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:03.138846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:03.139432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.140581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:03.141267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:03.141841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.358182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:03.367597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42ddbede-cfcd-4682-83a4-a8a6c041b347 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.246931 Sep 12 11:56:03.383557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 230/460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:03 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:03.389432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:03.390175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:03.397239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:03.398142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:03.398925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.399852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:03.400464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:03.401052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.493565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:03.509657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc1a9b39-5fae-418c-9a2c-1bee35d96907 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1362 microversion: 2.1 time: 0.654241 Sep 12 11:56:03.513194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 231/461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:02 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:03.710243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0091a504-f12a-4e6c-81fa-fbffd4805e6c", "name": "network-vif-plugged", "status": "completed", "tag": "97caae66-7f53-4c32-88b7-4710eddd6d85"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:03.733416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:03.733929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:03.734496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:03.757494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] Creating event network-vif-plugged:97caae66-7f53-4c32-88b7-4710eddd6d85 for instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c on hv-cinder-85331 Sep 12 11:56:03.763990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-eb822c9c-7e5d-40ed-b582-e78a40a55c76 req-48b3f848-7974-4175-8116-073324f5e124 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058396 Sep 12 11:56:03.765196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 232/462] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:03.772618 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:03.781440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0568fee4-64ad-4794-8d2e-4fd8894fd7d6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.396713 Sep 12 11:56:03.798863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 231/463] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:03 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:04.064070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:04.064786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:04.081646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.082803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.083536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.084953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.085787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.086442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.389959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:04.390604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:04.407261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.409143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.410035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.410816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.411305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.414091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.732206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:04.742569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf676f8c-ee6b-4057-bd48-1f5fd74b44ae tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.356517 Sep 12 11:56:04.744142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 232/464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:04 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:04.744826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:04.750615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:04.751731 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:04.754273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de3ba2c0-5904-427b-a482-3249d7e908d5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.698112 Sep 12 11:56:04.758858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.759617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.760266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.761533 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.762226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.762943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 233/465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:04 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:04.763508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.807317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:04.808058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:04.815774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.816561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.817173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.818318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.818960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.819737 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.923641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:04.932097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f7555bd-a615-4915-b708-3248b0f89dd5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1548 microversion: 2.1 time: 0.186497 Sep 12 11:56:04.934004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 233/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:04 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:04.957749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:04.958259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:04.965702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.966922 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.967365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:04.968318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:04.968977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:04.969597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:05.132654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f433f3b0-ca3a-48b0-a51f-9f4d06204a14 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179144 Sep 12 11:56:05.141790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 234/467] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 11:56:04 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:56:05.298636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:05.317241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c31e75f7-76d0-4d4e-91e6-9b50eff6e691 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1319 microversion: 2.1 time: 0.514794 Sep 12 11:56:05.335088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 234/468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:04 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:05.770150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:05.770876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:05.784914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:05.786983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:05.812746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:05.815217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:05.815738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:05.817263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:05.818268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:05.818787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:05.819690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:05.820367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:05.821214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:05.823146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:05.823664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:05.825723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:06.283438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:06.297500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-67775ed2-77b8-4e5f-ab22-94a801975bed tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.518388 Sep 12 11:56:06.298879 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 235/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:05 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:06.341435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:06.342045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:06.348002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:06.348478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:06.349143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:06.349842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:06.350468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:06.350919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:06.480384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:06.493730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d091c192-0d2d-4bf7-98ca-906890819268 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.727893 Sep 12 11:56:06.511004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:05 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:06.646317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:06.656129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-420b8993-3e46-4609-b9f5-5d14501fbc77 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1509 microversion: 2.1 time: 0.318529 Sep 12 11:56:06.657162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 236/471] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:06 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:07.008559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bff9ca9-92fa-4ad9-867f-4f889d1261bc", "tag": "1f7a6854-4f86-4255-8146-a2403a0437ef"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:07.020028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:07.020510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:07.021015 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:07.038569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] Creating event network-changed:1f7a6854-4f86-4255-8146-a2403a0437ef for instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc on hv-cinder-85331 Sep 12 11:56:07.046304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-40bae110-02f3-456f-a67f-23d7cbeaae72 req-680b700f-ca90-4e42-ae9b-b94417b54d27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041755 Sep 12 11:56:07.050191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 236/472] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:07.324829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:07.325459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:07.328315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:07.329490 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=8 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:07.351758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:07.352349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:07.352806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:07.355709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:07.358687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:07.359376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:07.519238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:07.519966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:07.532566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:07.533068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:07.533504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:07.534219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:07.534704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:07.535132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:07.774152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:07.790595 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c497a76d-00c1-4e88-97f3-3633e9ab7833 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.276233 Sep 12 11:56:07.792265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 237/473] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:07 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:07.874845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:07.885335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-88164fb5-c029-4d58-a85d-8fdd7c6efff5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.565691 Sep 12 11:56:07.907992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 237/474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:07 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:08.820656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:08.826932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:08.864065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:08.864869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:08.865487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:08.870178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:08.872554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:08.874868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:08.916159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:08.916957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:08.931791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:08.936987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:08.937869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:08.941827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:08.945093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:08.945734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:09.176270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:09.187240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-423bab81-28df-4406-b915-d2f42c730b06 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.370978 Sep 12 11:56:09.189346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 238/475] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:08 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:09.361492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:09.372036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4fddbf16-5df4-4d6e-bf1a-91c3d4c5a75c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.460412 Sep 12 11:56:09.373297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 238/476] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:08 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:10.217889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:10.218578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:10.225516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:10.225997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:10.226429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:10.227134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:10.227585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:10.228006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:10.342827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2e37ab8-0e2a-4d07-8baa-c52399dca440 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Action: 'create', calling method: .version_select at 0x7fc93a768f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2051257965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGp7E5Uuf4u+qorTiy1pQCl8LTcP9AHf0e73lKa+ucDEeZ6yRDYCRcYC1iui7PxEnkN7vrZ2uOcAMlzZQ6dUfyt/QJoPTCZjSuUJd5YdO1AUgIYt8Pd1MCTNM9zOhPsqw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:10.350481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:10.362207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-e2e37ab8-0e2a-4d07-8baa-c52399dca440 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for project 6d05fbbec08d43468068ce162f427eeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:56:10.366238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-e2e37ab8-0e2a-4d07-8baa-c52399dca440 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for user fb4bb9cd41cd46ddb87a746e732a948f and project 6d05fbbec08d43468068ce162f427eeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:56:10.369471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:10.377706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-139ce6c5-2fb2-4a75-884f-f2c77ff0902f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.165135 Sep 12 11:56:10.383537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 239/477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:10 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:10.390194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2e37ab8-0e2a-4d07-8baa-c52399dca440 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.221488 Sep 12 11:56:10.396152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:10.396364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 239/478] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 11:56:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:10.397223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:10.403581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:10.404059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:10.404489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:10.406373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:10.406980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:10.407292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:10.605375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:10.616065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-829fdaf7-dceb-4511-8bad-cbe3823714df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.220339 Sep 12 11:56:10.617703 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:10 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:11.410982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:11.412195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:11.423013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:11.423612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:11.424071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:11.425037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:11.425712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:11.427214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:11.637429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:11.641637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:11.642599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:11.645105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1eaea962-585a-4ab7-96ed-47146d1b9209 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.239354 Sep 12 11:56:11.646322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 240/480] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:11 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:11.648778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:11.649266 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:11.649699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:11.650386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:11.650853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:11.651463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:11.847742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:11.856915 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-37622dca-a22a-494f-80fb-126cef811c7e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.219991 Sep 12 11:56:11.857502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 241/481] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:11 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:12.671613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:12.672982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:12.679021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:12.679764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:12.680460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:12.681370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:12.682059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:12.682581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:12.839964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:12.850713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a241dc6-2783-4e12-b7ba-a4fa36591324 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.183268 Sep 12 11:56:12.859018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 241/482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:12 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:12.880930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:12.881570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:12.890094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:12.891660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:12.892532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:12.893968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:12.895207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:12.895861 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:13.266410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:13.277097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-42b00aa5-4aff-49fe-849b-b905b6728520 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.399445 Sep 12 11:56:13.284141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 242/483] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:12 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:13.875132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:13.875733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:13.885189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:13.886638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:13.887279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:13.888642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:13.889202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:13.889721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:13.890985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5d72-078b-417b-a00c-8a48e7d7c162", "name": "network-vif-plugged", "status": "completed", "tag": "1fefe1ab-340a-42cc-ae4d-138c66b351e6"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:13.919513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:13.922261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:13.922990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:13.936738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] Creating event network-vif-plugged:1fefe1ab-340a-42cc-ae4d-138c66b351e6 for instance 514f5d72-078b-417b-a00c-8a48e7d7c162 on hv-cinder-85331 Sep 12 11:56:13.942098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e64ce930-b01b-499e-988c-bb3d177c9e03 req-4503c3c2-e628-45e9-aa27-ef103c21f15a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056252 Sep 12 11:56:13.943762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 243/484] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:56:14.155973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:14.168384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a190a97-e6ee-4524-984f-518df6d97ed0 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.295935 Sep 12 11:56:14.169281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 242/485] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:13 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:14.307377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:14.308811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:14.315372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:14.315939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:14.316439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:14.317756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:14.318280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:14.318819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:14.483864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:14.491787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e1908a1a-584b-493f-8ee2-876a4272d7e6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.188535 Sep 12 11:56:14.492731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 244/486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:14 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:15.192747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:15.193355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:15.207078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.207566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.207992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.208935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.209600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.210036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.357768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:15.370091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-688335ed-e915-4b89-a80d-afa00c1ade75 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.182581 Sep 12 11:56:15.370727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 243/487] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:15 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:15.517233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:15.517980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:15.524885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.525488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.525928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.526809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.527272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.527695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.659692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:15.667872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d305cd08-c85b-42ac-87e9-a168acb09831 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1502 microversion: 2.1 time: 0.154429 Sep 12 11:56:15.668448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 245/488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:15 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:15.690685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2ff4f11-d30f-4600-80a0-3365fcc33acc"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:15.693282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:15.699753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.700231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.700663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.701341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.701791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.702216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.726264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] HTTP exception thrown: Cannot 'attach_volume' instance 4310e71e-de3e-4855-8800-8bb60f9d8428 while it is in vm_state rescued Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Request method failure captured: Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/os-volume_attachments HTTP/1.1 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 74 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2pk6V14JcYQLujBB4-HkiOoGyStG7TOyLJKTe_ZIU4APyDWKn0SP86S_McGOg4GujcFNCzKDMuTD-HiIz___jSXF5z45qU319_0Tv4ibuaQpqMgO1ScLbkuiVXVMFtC2Xmid0u8fK0DnuxI6OeRKbjnvxdEOOZv9k_HBesY3QlyJM Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 92efab98bce54b08899f057951b42617 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:56:15.728459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/92efab98bce54b08899f057951b42617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_92efab98bce54b08899f057951b42617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}] Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 92efab98bce54b08899f057951b42617 Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 66682d5656d3414eaebba666d4e0771f Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "a2ff4f11-d30f-4600-80a0-3365fcc33acc"}} Sep 12 11:56:15.730195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Cannot 'attach_volume' instance 4310e71e-de3e-4855-8800-8bb60f9d8428 while it is in vm_state rescued Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'server_id': '4310e71e-de3e-4855-8800-8bb60f9d8428', 'body': {'volumeAttachment': {'volumeId': 'a2ff4f11-d30f-4600-80a0-3365fcc33acc'}}} Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:56:15.731384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4310e71e-de3e-4855-8800-8bb60f9d8428 while it is in vm_state rescued Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:56:15.732660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4310e71e-de3e-4855-8800-8bb60f9d8428 while it is in vm_state rescued Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Returning 409 to user: Cannot 'attach_volume' instance 4310e71e-de3e-4855-8800-8bb60f9d8428 while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cdf8989-8a10-4fe9-83f1-af325a20adce tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043365 Sep 12 11:56:15.733909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 244/489] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:56:15 2022] POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 11:56:15.739632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:15.740160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:15.746754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.747244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.747680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.748440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.748914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.749337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.825909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-22642200-4df0-452a-b968-0ef03ff70cda tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/action" status: 202 len: 0 microversion: 2.1 time: 0.090104 Sep 12 11:56:15.826586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 246/490] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:56:15 2022] POST /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:56:15.835236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:15.835878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:15.842565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.843058 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.843501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.844193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:15.844651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:15.845079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:15.849829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:15.983921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:15.991646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd3f4fbd-4cca-4db5-a0f2-d0eaecf1ad16 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.160524 Sep 12 11:56:15.992200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 245/491] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:15 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:16.394697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:16.395564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:16.402676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:16.403275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:16.403807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:16.404500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:16.404953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:16.406076 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:16.409524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:16.565416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:16.575667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12aa77d1-8480-4b55-b01e-cf20f815040b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.185457 Sep 12 11:56:16.576863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 247/492] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:16 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:17.022498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:17.023144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:17.029895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:17.030311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:17.030777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:17.031540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:17.032085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:17.032542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:17.167403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:17.175864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af89ea52-10a6-4d34-ba66-db62298df8e4 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.162983 Sep 12 11:56:17.176425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 246/493] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:17 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:17.600085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:17.600833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:17.607828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:17.608303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:17.608753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:17.609437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:17.609938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:17.610375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:17.819272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:17.827753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-744865c1-7fe6-47ea-a036-9217d7688e4f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1314 microversion: 2.1 time: 0.231550 Sep 12 11:56:17.828303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 248/494] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:17 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:18.200932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:18.201688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:18.208644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:18.209139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:18.209580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:18.210281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:18.210764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:18.211191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:18.341178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:18.348803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e6ebaee-fad2-4dde-81a0-5fb86295c497 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.152033 Sep 12 11:56:18.349355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 247/495] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:18 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:18.853022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:18.853645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:18.860472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:18.861207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:18.861638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:18.862330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:18.862817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:18.863242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.005075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:19.016531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eee69e8b-6440-4fea-9f84-a18cb4e56aa2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1498 microversion: 2.1 time: 0.167341 Sep 12 11:56:19.017226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 249/496] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:18 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:19.373569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:19.374174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:19.379870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.380352 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.380791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.381487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.382001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.382409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.520575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:19.528722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06dc6f40-c936-4a2a-9a34-8bd96150adfe tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.159819 Sep 12 11:56:19.529286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 248/497] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:19 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:19.795478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:19.795997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:19.801855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.802333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.802804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.803492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.803947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.804371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.829906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:56:19.904244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c28f1382-400b-4cbd-9adf-d3b0497c7e8d tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "DELETE /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 204 len: 0 microversion: 2.1 time: 0.112898 Sep 12 11:56:19.904891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 250/498] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:56:19 2022] DELETE /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:56:19.912902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:19.913512 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:19.919870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.920349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.920783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:19.921466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:19.921918 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:19.922341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:20.063542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:20.071682 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f34ffdf-ccd2-4bab-9b5f-df9d645f4dee tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.162576 Sep 12 11:56:20.072240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 249/499] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:19 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:20.553547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:20.554243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:20.560476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:20.560951 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:20.561381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:20.562050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:20.562499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:20.562941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:20.701838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:20.710527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4dcc22e-278a-4a51-9dc6-f6a9710a09b1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.161146 Sep 12 11:56:20.711094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:20 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:21.094795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:21.095489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:21.097287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:21.102698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:21.103182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:21.103621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:21.104305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:21.104763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:21.105709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:21.241734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:21.250946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1310d19-65c0-4f6e-b97d-b2cff1d06f58 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.160096 Sep 12 11:56:21.251519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:21 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:21.734007 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:21.734561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:21.740890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:21.741363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:21.741790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:21.742460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:21.742933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:21.743350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:21.876878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:21.887152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d359726e-0319-4448-8582-d2028b334d5f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.156894 Sep 12 11:56:21.887843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 252/502] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:21 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:22.274811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:22.275422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:22.281448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:22.282016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:22.282460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:22.283288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:22.283745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:22.284205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:22.417688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:22.425276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36922687-698d-47d5-9ed1-95022126be91 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.154414 Sep 12 11:56:22.425838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:22 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:22.911271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:22.911881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:22.918277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:22.918803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:22.920144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:22.920946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:22.921407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:22.921836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:23.054679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:23.062704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1eb7182f-22e9-4515-9fe6-438880c3fef5 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1510 microversion: 2.1 time: 0.155478 Sep 12 11:56:23.063267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:22 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:23.449202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:23.449907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:23.457015 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:23.457538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:23.457966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:23.458724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:23.459177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:23.459605 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:23.591358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:23.600387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7445789-02dd-4ec5-bccf-5f8215518e72 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.155032 Sep 12 11:56:23.601083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 252/505] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:23 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:24.085383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:24.085904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:24.093388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:24.093878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:24.094318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:24.095060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:24.095514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:24.095935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:24.230868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:24.242031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-924d8d27-2ee0-427d-9603-687e95675a11 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1516 microversion: 2.1 time: 0.160613 Sep 12 11:56:24.242771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 254/506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:24 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:24.623434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:24.624032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:24.629842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:24.630317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:24.630778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:24.631453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:24.631902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:24.632318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:24.765256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:24.773119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab980fda-3aef-44bd-a708-bf1771af1d18 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.153443 Sep 12 11:56:24.773708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 253/507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:24 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:25.797751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:25.798410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:25.805751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:25.806222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:25.806684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:25.807358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:25.807803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:25.808218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:25.936089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:25.943964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cbd11f89-a35e-4d64-bdcd-cb9c3ace70b6 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.150734 Sep 12 11:56:25.944527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 255/508] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:25 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:26.968447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:26.968992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:26.974980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:26.975469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:26.975896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:26.976569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:26.977019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:26.977443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:27.107817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:27.115557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b882e4be-4331-455d-980e-d4dc5d66806b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.151723 Sep 12 11:56:27.116114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 254/509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:26 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:28.138950 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:28.139562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:28.146075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:28.146584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:28.147020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:28.147696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:28.148151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:28.148569 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:28.280669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:28.288197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d72f443a-168c-4414-b506-2364590839b3 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.153396 Sep 12 11:56:28.288844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 256/510] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:28 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:29.312309 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:29.312945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:29.319022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:29.319492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:29.319914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:29.320584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:29.321028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:29.321443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:29.450833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:29.458653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b972f1b9-0f31-41bd-886a-285e8d98eda5 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.150799 Sep 12 11:56:29.460142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 255/511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:29 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:30.482946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:30.483484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:30.489571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:30.490041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:30.490466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:30.491157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:30.491603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:30.492018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:30.623013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:30.631941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3475e2e3-ebfc-44c4-a3da-e68ce87b8491 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.152957 Sep 12 11:56:30.632551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 257/512] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:30 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:31.655320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:31.655932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:31.662125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:31.662643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:31.663083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:31.663777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:31.664233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:31.664661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:31.797253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:31.804812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7c9ef92-dda3-4291-b914-6f343460519a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.154264 Sep 12 11:56:31.805370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 256/513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:31 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:32.152553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5d72-078b-417b-a00c-8a48e7d7c162", "name": "network-vif-unplugged", "status": "completed", "tag": "1fefe1ab-340a-42cc-ae4d-138c66b351e6"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:32.157887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:32.164854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:32.165344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:32.166106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:32.178485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] Creating event network-vif-unplugged:1fefe1ab-340a-42cc-ae4d-138c66b351e6 for instance 514f5d72-078b-417b-a00c-8a48e7d7c162 on hv-cinder-85331 Sep 12 11:56:32.183688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-bb2b4895-c40a-46e9-9a42-656e5c65bb4d req-02376365-e3b7-4eea-896b-10c33e89d728 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034871 Sep 12 11:56:32.185052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 258/514] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:32.827756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:32.828449 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:32.834725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:32.835334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:32.835834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:32.836776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:32.837300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:32.837796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:32.973704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:32.981924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3b8c553-c885-43a8-849c-cf1510bfbb0e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1504 microversion: 2.1 time: 0.158003 Sep 12 11:56:32.982539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 257/515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:32 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:33.423387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5d72-078b-417b-a00c-8a48e7d7c162", "name": "network-vif-deleted", "tag": "1fefe1ab-340a-42cc-ae4d-138c66b351e6"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:33.436250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:33.436731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:33.437166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:33.449280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] Creating event network-vif-deleted:1fefe1ab-340a-42cc-ae4d-138c66b351e6 for instance 514f5d72-078b-417b-a00c-8a48e7d7c162 on hv-cinder-85331 Sep 12 11:56:33.455388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-235dab5a-f963-4cb8-8f85-131d05e6af32 req-dadea751-daec-4674-8ed2-5a3b5dae0ad8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036853 Sep 12 11:56:33.456431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 259/516] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:34.005859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:34.006369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:34.012522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:34.013007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:34.013442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:34.014202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:34.014588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:34.015053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:34.045711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:34.046190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:34.046651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:34.047093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lazy-loading 'fault' on Instance uuid 514f5d72-078b-417b-a00c-8a48e7d7c162 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:56:34.095538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:34.103158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-196621cf-49e5-436e-927b-10f7dfd7603b tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 200 len: 1304 microversion: 2.1 time: 0.101779 Sep 12 11:56:34.103717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 258/517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:34 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:35.128640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:35.129411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eae9fda-f08f-45ea-aec9-e10c8f66b620 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: .version_select at 0x7fc93a4475e0>, body: {"keypair": {"name": "tempest-keypair-1019313028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxPNGNcrlReeuJYHyfYqa5Gf3EJSuWYzYrJ0gErTtX3IxvrXbeOhhOtE5YJuAgvwdj6Ve5RaX8a4o3gy+g7g95/7/yERzdxwnM6d3Uk1a0Ue0XoD/a7mCYfmhO9zBzE2g=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:35.129809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: 514f5d72-078b-417b-a00c-8a48e7d7c162] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:35.138917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:35.139480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:35.140159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:35.141050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:35.141706 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:35.142236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:35.150494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-7eae9fda-f08f-45ea-aec9-e10c8f66b620 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for project 92efab98bce54b08899f057951b42617. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:56:35.154463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-7eae9fda-f08f-45ea-aec9-e10c8f66b620 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for user 66682d5656d3414eaebba666d4e0771f and project 92efab98bce54b08899f057951b42617. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:56:35.156031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] HTTP exception thrown: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Request method failure captured: Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 HTTP/1.1 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx5KVMqZ8GCZyVtrGHMi36ThgC9yIu8-hPjOB--r47kKzy-Ruyhu-QWtfwC_3D11J9yHp3QGKhhFf7qCV0-sN_IMqnIOZMpbkN0ZE_lMloLVYx2R9rsyT-4g1W3DJy3bpxDXJraLKWCsAawYth2exxO2UwS0xPcE6YcRbq98yY5KnU0 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: d01561573a044c87a4102522b8fe8432 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesActionsTest-1611655483 Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:56:35.157555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d01561573a044c87a4102522b8fe8432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d01561573a044c87a4102522b8fe8432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d01561573a044c87a4102522b8fe8432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d01561573a044c87a4102522b8fe8432"}]}] Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesActionsTest-1611655483 Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: d01561573a044c87a4102522b8fe8432 Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesActionsTest-1611655483 Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesActionsTest-1611655483-project Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 5167ece674de4c11b71bb63db58f9eb3 Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesActionsTest-1611655483-project Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. Sep 12 11:56:35.159271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '514f5d72-078b-417b-a00c-8a48e7d7c162'} Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:56:35.163340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. Sep 12 11:56:35.164610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:56:35.165737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Returning 404 to user: Instance 514f5d72-078b-417b-a00c-8a48e7d7c162 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:56:35.165737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a71f7c74-24ba-4589-8862-6014f41f3e4e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162" status: 404 len: 111 microversion: 2.1 time: 0.035160 Sep 12 11:56:35.165737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 259/518] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:35 2022] GET /compute/v2.1/servers/514f5d72-078b-417b-a00c-8a48e7d7c162 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:56:35.196349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7eae9fda-f08f-45ea-aec9-e10c8f66b620 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072313 Sep 12 11:56:35.197299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 260/519] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 11:56:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:35.265953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1866040643", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "networks": [{"uuid": "2facb9c9-2860-46c3-a7a5-51de9d3fd301"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:35.321199 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] validate_networks() for [('2facb9c9-2860-46c3-a7a5-51de9d3fd301', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:56:35.803749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:56:35.804312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:56:35.804920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:56:35.806702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:56:35.806702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:56:35.816156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:35.817808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:35.817808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:35.818187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:35.818679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:35.819110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:35.836520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Getting quotas for project d01561573a044c87a4102522b8fe8432. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:56:35.841251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Getting quotas for user 5167ece674de4c11b71bb63db58f9eb3 and project d01561573a044c87a4102522b8fe8432. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:56:35.853657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:56:35.858373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:56:35.907951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ab4c4ff-c385-4d96-9b46-294be7b611d8 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645906 Sep 12 11:56:35.914989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 260/520] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:56:35.922240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cc558d1e-f071-4749-8ca0-705098cc3222 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:35.923019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cc558d1e-f071-4749-8ca0-705098cc3222 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:36.011541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cc558d1e-f071-4749-8ca0-705098cc3222 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:36.021306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cc558d1e-f071-4749-8ca0-705098cc3222 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1214 microversion: 2.1 time: 0.104693 Sep 12 11:56:36.021955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 261/521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:35 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:36.803006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1265592959", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "454d7b87-e358-46f8-af08-f1619c1182de"}], "security_groups": [{"name": "tempest-securitygroup--736190096"}], "key_name": "tempest-keypair-1019313028", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:36.936802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] validate_networks() for [('454d7b87-e358-46f8-af08-f1619c1182de', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:56:37.062246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:37.062246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:37.068245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:37.068729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:37.069155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:37.070110 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:37.070732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:37.071260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:37.160875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:37.169497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2073e49e-11bf-4565-a56e-4a2191ec081e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1266 microversion: 2.1 time: 0.113454 Sep 12 11:56:37.170251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 262/522] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:37 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:37.578204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:56:37.578664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:56:37.579139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:56:37.579541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:56:37.579950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:56:37.588380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:37.588857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:37.589283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:37.590024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:37.590686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:37.591107 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:37.609101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:56:37.613026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Getting quotas for user 66682d5656d3414eaebba666d4e0771f and project 92efab98bce54b08899f057951b42617. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:56:37.626745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:56:37.628912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:56:37.677191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-056faf66-5c52-49be-99c2-3949b0fe9991 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.888308 Sep 12 11:56:37.678013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 261/523] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:56:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:56:37.691434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-557f2607-f857-4b64-98dd-b9287d1cd67c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:37.692650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-557f2607-f857-4b64-98dd-b9287d1cd67c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:37.774538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-557f2607-f857-4b64-98dd-b9287d1cd67c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:37.782930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-557f2607-f857-4b64-98dd-b9287d1cd67c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1246 microversion: 2.1 time: 0.096631 Sep 12 11:56:37.783715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 263/524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:37 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:38.195788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:38.197111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:38.205080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:38.205865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:38.206543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:38.207628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:38.208302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:38.209048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:38.357099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:38.366679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39cb8617-482e-4645-96ad-460d6828ad1a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.177235 Sep 12 11:56:38.367381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 262/525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:38 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:38.807445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:38.808063 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:38.815822 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:38.816292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:38.817207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:38.817895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:38.818564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:38.819171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:38.907264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:38.914921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8b73ee76-71b3-40fb-ae63-19a518ee5ddf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1298 microversion: 2.1 time: 0.111481 Sep 12 11:56:38.915674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 264/526] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:38 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:38.962320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ee8994-b7f5-47fe-a951-a56dd04180b6", "tag": "7e77e154-d004-4af9-a258-cc789b382f21"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:38.973555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:38.974167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:38.974657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:38.988430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] Creating event network-changed:7e77e154-d004-4af9-a258-cc789b382f21 for instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 on hv-cinder-85331 Sep 12 11:56:38.994434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-aecee712-6dce-4007-afbf-0369d8712c7c req-9a3d72f9-b589-4809-a8aa-876ed1647a0f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036023 Sep 12 11:56:38.995068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 263/527] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:39.391103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:39.392286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:39.401604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:39.403537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:39.404647 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:39.405650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:39.406542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:39.407203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:39.652922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:39.661420 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2eaff2b3-484c-4aaf-9daa-f81456abf4fb tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.275871 Sep 12 11:56:39.662258 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 265/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:39 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:39.942442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:39.943376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:39.951521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:39.952125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:39.952660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:39.953439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:39.954076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:39.954499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:39.959331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:40.041459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:40.053926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-593a9efa-61a7-4b21-8a68-2a3e29613c59 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1304 microversion: 2.1 time: 0.117891 Sep 12 11:56:40.055615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 264/529] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:39 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:40.685353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:40.686121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:40.692870 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:40.694003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:40.694094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:40.694914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:40.695527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:40.695954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:40.716192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:40.842755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:40.850687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bb8e451-63d7-41f6-9574-ac0977a7d1ba tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.169728 Sep 12 11:56:40.851132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 266/530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:40 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:41.085576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:41.086891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:41.094945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:41.098336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:41.099515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:41.100267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:41.101491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:41.102278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:41.103049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:41.259396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:41.267069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b47e5d91-4666-4673-9de7-1b4dfb61f980 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.189860 Sep 12 11:56:41.282266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 265/531] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:41 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:41.873717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:41.874316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:41.880903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:41.881394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:41.881835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:41.882817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:41.883084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:41.883505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:42.016753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:42.024182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7979a3a5-06d1-4b33-955a-7fcbc0873965 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.154485 Sep 12 11:56:42.024898 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 267/532] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:41 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:42.289828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:42.290434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:42.296449 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:42.296951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:42.297387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:42.298060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:42.298589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:42.298957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:42.445387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:42.453163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e8e3ceb-41e4-466c-8758-c93848c3c571 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.167158 Sep 12 11:56:42.453724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 266/533] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:42 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:43.046965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:43.047557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:43.054081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:43.054587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:43.055019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:43.055694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:43.056141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:43.056556 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:43.191590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:43.199148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e929f35f-4777-4670-b184-84c9a1e1e732 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.156057 Sep 12 11:56:43.199707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 268/534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:43 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:43.476205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:43.476807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:43.483187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:43.483657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:43.484085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:43.484758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:43.485207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:43.485625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:43.617109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:43.625996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c724e2b3-5ec4-4dd7-89a5-0172801852c7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.153485 Sep 12 11:56:43.626635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 267/535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:43 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:44.222445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:44.223152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:44.230057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:44.230563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:44.230994 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:44.231837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:44.232347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:44.232855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:44.376593 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:44.384534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-560833ed-d752-401d-9cbf-fbb33fbc2148 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.166323 Sep 12 11:56:44.385155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 269/536] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:44 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:44.649095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:44.649614 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:44.655509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:44.655986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:44.656415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:44.657089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:44.657536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:44.657959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:44.790097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:44.798278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66f2cb0c-f74e-4d09-a1a1-aa2901c8d3df tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.153207 Sep 12 11:56:44.798865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 268/537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:44 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:45.410282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:45.410991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:45.418237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:45.418903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:45.419979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:45.420930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:45.421383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:45.421807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:45.560885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:45.568717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-284f328b-b963-46c8-a556-f65abd0970a2 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.163932 Sep 12 11:56:45.569274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 270/538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:45 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:45.822271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:45.822815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:45.829118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:45.829610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:45.830064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:45.830771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:45.831234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:45.831657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:45.963920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:45.971591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a37a5e1-351e-4f0c-9c66-d32f58317239 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.153864 Sep 12 11:56:45.972155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 269/539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:45 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:46.592665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:46.593285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:46.599667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:46.600157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:46.600594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:46.601315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:46.601775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:46.602686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:46.642559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:46.652097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:46.652581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:46.653015 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:46.665466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] Creating event network-changed:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 11:56:46.670902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ee2d0612-d8e2-4c39-b5e7-2bc3bf138ff0 req-2bb57207-0126-4437-a978-ace82a73058f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 Sep 12 11:56:46.671668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 270/540] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:46.748408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:46.756315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-68c2ec58-f1e1-4145-b013-7f2a61d71f39 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.168394 Sep 12 11:56:46.756878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 271/541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:46 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:46.995333 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:46.995979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:47.006253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:47.007042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:47.007716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:47.008805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:47.009516 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:47.010216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:47.279609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:47.287555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d62e3f84-6a17-4a27-8cb2-d2e411bcd097 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.296457 Sep 12 11:56:47.288123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 271/542] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:46 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:47.585031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ee8994-b7f5-47fe-a951-a56dd04180b6", "name": "network-vif-plugged", "status": "completed", "tag": "7e77e154-d004-4af9-a258-cc789b382f21"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:47.596900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:47.599114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:47.599626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:47.614201 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] Creating event network-vif-plugged:7e77e154-d004-4af9-a258-cc789b382f21 for instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 on hv-cinder-85331 Sep 12 11:56:47.620299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-6db4c906-6fbd-45dd-804a-970a8a57aa35 req-aaef6a58-462d-43ea-af54-ec31e16153f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038876 Sep 12 11:56:47.621269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 272/543] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:56:47.781187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:47.782102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:47.784233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:47.785226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:47.791536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:47.792022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:47.792450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:47.793145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:47.793592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:47.794085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:47.929487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:47.937590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d01a0264-7047-4416-88a1-3ebe7b348cce tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.161746 Sep 12 11:56:47.938146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 272/544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:47 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:48.307244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=8 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:48.312123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:48.312818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:48.319542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:48.320027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:48.320463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:48.321144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:48.321598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:48.322019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:48.455978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:48.463706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-321b5740-1f29-400d-bb0f-f66a86c279d8 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.157437 Sep 12 11:56:48.464295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 273/545] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:48 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:48.961069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:48.961671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:48.967675 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:48.968152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:48.968581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:48.969254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:48.969702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:48.970118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:49.101775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:49.109920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa39da9f-0da1-4cf4-8cd8-a50c4dd710c7 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.152725 Sep 12 11:56:49.110761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 273/546] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:48 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:49.487880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:49.488420 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:49.494864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:49.495337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:49.495772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:49.496442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:49.496907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:49.497367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:49.631036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:49.638728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bff83399-a299-4f90-87c6-431929f8f3d3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.154761 Sep 12 11:56:49.639290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 274/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:49 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:50.132877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:50.133479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:50.140260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.140736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.141162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:50.141834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.142278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.142725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:50.276501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:50.284132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23a3d5ba-d6ed-49e0-aee8-6d190cb2c21a tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.155120 Sep 12 11:56:50.284687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 274/548] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:50 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:50.665122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:50.665723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:50.672182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.672657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.673084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:50.673757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.674206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.674652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:50.810567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:50.818936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-49f4c34a-510d-43c9-8840-a3badb675951 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.157582 Sep 12 11:56:50.819495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 275/549] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:50 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:50.820469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e87a15c-877b-4f30-92d9-27a33931a063", "device": "/dev/sdb"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:50.823346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:50.830041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.830537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.830971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:50.831651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:50.832098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:50.832514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:51.306282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:51.306832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:51.313121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:51.313602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:51.314026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:51.314726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:51.315198 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:51.315615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:51.448016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:51.456345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-279848cd-7de2-4ae9-9b48-5cbce37408f4 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.153995 Sep 12 11:56:51.457167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 276/550] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:51 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:51.842775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:51.843446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:51.849701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:51.850181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:51.850645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:51.851331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:51.851790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:51.852217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:51.988536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:51.996284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b1b0e23b-15c6-4dae-a9ee-1f6ecc98dbba tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.157541 Sep 12 11:56:51.997481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 277/551] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:51 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:52.480206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:52.480823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:52.487718 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:52.488200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:52.488641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:52.489333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:52.489790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:52.490217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:52.623050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:52.630956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0a103522-f8f7-469f-8d9e-fa459bf67d85 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.154590 Sep 12 11:56:52.631536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 278/552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:52 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:53.019621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:53.021048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:53.027588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:53.028152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:53.028641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:53.029834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:53.030287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:53.030752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:53.033996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf047201-2d3c-42db-810c-040491de92f6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "POST /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.217579 Sep 12 11:56:53.034935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 275/553] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:56:50 2022] POST /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c/os-volume_attachments => generated 194 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:56:53.179799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:53.188369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0cf18ba-2a05-4877-8a54-e12f91cd175a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.172603 Sep 12 11:56:53.188950 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 279/554] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:53 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:53.654041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:53.654760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:53.661859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:53.662338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:53.662800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:53.663489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:53.663937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:53.664488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:53.800694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:53.808881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28cb6558-28b4-4c45-9d0d-fb5566ae5a53 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.159349 Sep 12 11:56:53.810098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 276/555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:53 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:54.212361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:54.212972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:54.220021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:54.220499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:54.220928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:54.221598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:54.222045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:54.222463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:54.350199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:54.357729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-17ed3f3a-8ac9-4ccc-b417-c42ee97989d0 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.149423 Sep 12 11:56:54.358298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 280/556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:54 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:54.832991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:54.833631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:54.840269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:54.840786 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:54.841328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:54.842388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:54.842718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:54.843443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:54.972959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:54.980418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bb09ebc-b682-4db2-bad0-9a65fc9b6249 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.151273 Sep 12 11:56:54.981014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 277/557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:54 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:55.382265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:55.383214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:55.392568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:55.393284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:55.393935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:55.394998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:55.395685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:55.396324 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:55.533056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:55.540713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6817963e-d8ad-4c70-bfe6-edbda0506533 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.164628 Sep 12 11:56:55.541278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 281/558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:55 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:56.003448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:56.004130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:56.010630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:56.011126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:56.011565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:56.012269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:56.012718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:56.013144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:56.141435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:56.149080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d540702-a252-45be-ab6a-1800a28e49cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1314 microversion: 2.1 time: 0.149397 Sep 12 11:56:56.149589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 278/559] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:55 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:56.563693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:56.564229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:56.570812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:56.571286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:56.571716 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:56.572389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:56.572834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:56.573249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:56.701384 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:56.708846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6a46f416-626e-4527-9589-dd21ebe95f17 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.149830 Sep 12 11:56:56.709405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 282/560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:56 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:56.911665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "name": "network-vif-plugged", "status": "completed", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:56:56.922866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:56.923315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:56.923774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:56.937749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] Creating event network-vif-plugged:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 11:56:56.943192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a0056d5f-3af9-4f00-9269-b0e576dfd98f req-1faa11fd-7c97-4f7f-a92f-a56a33bfd212 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034936 Sep 12 11:56:56.943773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 279/561] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:56:57.172565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:57.173275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:57.179580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.180152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.180656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.181423 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.181945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.182434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.323003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:57.326555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:57.332077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d615ae6f-735a-4608-b0fd-44065b2e277e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1497 microversion: 2.1 time: 0.163960 Sep 12 11:56:57.333216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 283/562] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:57 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:57.734371 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:57.735096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:57.741666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.742154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.742619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.743305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.743765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.744193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.879944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:57.883492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:56:57.889576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c70b45f2-2dc6-4a70-b9e9-07002b55b49d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.159912 Sep 12 11:56:57.890482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 280/563] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:57 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:57.911161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:57.911740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:57.919023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.919452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.919890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.920581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:57.921038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:57.921466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:57.946163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:56:58.023354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d96ae42c-5c34-4d56-b557-06507b694962 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 204 len: 0 microversion: 2.1 time: 0.116018 Sep 12 11:56:58.023875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 284/564] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:56:57 2022] DELETE /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:56:58.034345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:58.035156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:58.041916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:58.042394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:58.042852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:58.043561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:58.044016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:58.044432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:58.182241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:58.190412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70f02dd7-bb4b-45a4-911f-06516470195c tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1503 microversion: 2.1 time: 0.161536 Sep 12 11:56:58.191292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 281/565] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:58 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:56:58.913667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:58.914370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:58.921856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:58.922346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:58.923401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:58.923508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:58.923933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:58.924362 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:59.060441 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:59.068386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b1a1b1d-6287-46b4-ae60-4f5eeeb9409e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.159046 Sep 12 11:56:59.069017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 285/566] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:58 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:56:59.213524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:56:59.214119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:56:59.221093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:59.221562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:59.222018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:59.222716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:56:59.223165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:56:59.223581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:56:59.352440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:56:59.360360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bbccd45-8517-4fc4-89c6-146c38698936 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1503 microversion: 2.1 time: 0.150567 Sep 12 11:56:59.360937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 282/567] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:56:59 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:00.092434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:00.093049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:00.099616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:00.100098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:00.100532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:00.101211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:00.101666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:00.102086 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:00.233847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:00.241475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ada45ab1-534b-496d-978e-0c28c4bd4016 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.152955 Sep 12 11:57:00.242040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 286/568] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:00 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:00.383608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:00.384414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:00.391079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:00.391557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:00.391997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:00.392673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:00.393125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:00.393550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:00.525714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:00.533970 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34f9bdc8-c7cd-4395-be85-ecddb1ff9020 tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1503 microversion: 2.1 time: 0.154383 Sep 12 11:57:00.534536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 283/569] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:00 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:01.265989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:01.266658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:01.273014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.273595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.274227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.274944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.275399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.275826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.431190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ee8994-b7f5-47fe-a951-a56dd04180b6", "name": "network-vif-deleted", "tag": "7e77e154-d004-4af9-a258-cc789b382f21"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:01.448009 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:01.448858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.449673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.450448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.458306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4686cc57-6920-4892-88f8-391fafcf3784 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1371 microversion: 2.1 time: 0.196677 Sep 12 11:57:01.459199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 287/570] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:01 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:01.464386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] Creating event network-vif-deleted:7e77e154-d004-4af9-a258-cc789b382f21 for instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 on hv-cinder-85331 Sep 12 11:57:01.472290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1215043263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051257965", "security_groups": [{"name": "tempest-secgroup-smoke-604561767"}], "block_device_mapping_v2": [{"uuid": "ba397018-a7e0-402a-9f90-12e2233cd8f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7979205-0c82-4090-b1b7-10cd6c0b471c"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:01.472781 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-48c2033d-d8ac-4403-815d-e4d88f0f7dc0 req-c87722e2-5522-4163-8d65-3ae33b3da456 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046833 Sep 12 11:57:01.477017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 284/571] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:01.556828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:01.557872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:01.565385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.566393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.567123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.568035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.568693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.569318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.603583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] validate_networks() for [('d7979205-0c82-4090-b1b7-10cd6c0b471c', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:57:01.641732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:01.649433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7034d7b-6006-49ca-a0f1-ac3656e7e8cd tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1461 microversion: 2.1 time: 0.096834 Sep 12 11:57:01.650236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 285/572] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:01 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:01.982557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:57:01.983139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:57:01.983643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:57:01.984053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:57:01.984468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:57:01.993173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.993655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.994111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:01.995527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:01.995807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:01.996830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.013965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:57:02.017964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for user fb4bb9cd41cd46ddb87a746e732a948f and project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:57:02.076414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:57:02.078586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba397018-a7e0-402a-9f90-12e2233cd8f5',volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:57:02.217869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f0bb8769-cf0a-4961-83cf-bbe0befb465c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.750115 Sep 12 11:57:02.218434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 288/573] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:57:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:57:02.229606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ca8e05a-9736-4dc7-b3cf-e930301f4257 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:02.231755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ca8e05a-9736-4dc7-b3cf-e930301f4257 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:02.286208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ca8e05a-9736-4dc7-b3cf-e930301f4257 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:02.294100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ca8e05a-9736-4dc7-b3cf-e930301f4257 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1095 microversion: 2.1 time: 0.068460 Sep 12 11:57:02.294694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 286/574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:02 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:02.483422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:02.484078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:02.490090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.490603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.491044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.491735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.492342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.492721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.641622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:02.650540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cc57ec82-ba4a-475d-a9af-25f316c88ba1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1566 microversion: 2.1 time: 0.172073 Sep 12 11:57:02.651175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 289/575] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:02 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:02.672459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:02.672949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:02.673085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:02.673673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:02.675622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:02.679621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.680108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.680650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.681342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.681650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.681808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.682271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.682386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.682731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.683416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.684678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.685100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.717599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:02.718080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:02.718548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:02.718996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lazy-loading 'fault' on Instance uuid f5ee8994-b7f5-47fe-a951-a56dd04180b6 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:57:02.759983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5167ece674de4c11b71bb63db58f9eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01561573a044c87a4102522b8fe8432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:02.764947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-729b2d82-0dac-4789-8cad-c9e09cc7994c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095884 Sep 12 11:57:02.765539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 290/576] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 11:57:02 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:57:02.768709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce8d5889-2054-4d1e-965a-0f5fd1c3ce6f tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 200 len: 1304 microversion: 2.1 time: 0.100047 Sep 12 11:57:02.769260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 287/577] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:02 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:03.322474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:03.323135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:03.329546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:03.330034 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:03.330465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:03.331171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:03.331618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:03.332036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:03.406184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:03.418702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-27fe47cc-dd1d-4dd3-8116-3bd921658741 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1145 microversion: 2.1 time: 0.104608 Sep 12 11:57:03.419493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 291/578] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:03 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:03.693434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:03.704110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:03.704594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:03.705562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:03.726630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] Creating event network-changed:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 11:57:03.728629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-44e56f29-d21c-4cd5-86c4-7744d574cece req-cf58cfa6-65b0-4aea-b6f6-bfbd47b85099 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038994 Sep 12 11:57:03.729506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 288/579] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:03.791583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:03.792309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] [instance: f5ee8994-b7f5-47fe-a951-a56dd04180b6] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:03.798864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:03.799430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:03.799936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:03.800640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:03.801098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:03.801532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:03.817409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] HTTP exception thrown: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Request method failure captured: Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 HTTP/1.1 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx5KVMqZ8GCZyVtrGHMi36ThgC9yIu8-hPjOB--r47kKzy-Ruyhu-QWtfwC_3D11J9yHp3QGKhhFf7qCV0-sN_IMqnIOZMpbkN0ZE_lMloLVYx2R9rsyT-4g1W3DJy3bpxDXJraLKWCsAawYth2exxO2UwS0xPcE6YcRbq98yY5KnU0 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: d01561573a044c87a4102522b8fe8432 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesActionsTest-1611655483 Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:57:03.819092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d01561573a044c87a4102522b8fe8432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d01561573a044c87a4102522b8fe8432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d01561573a044c87a4102522b8fe8432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d01561573a044c87a4102522b8fe8432"}]}] Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesActionsTest-1611655483 Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: d01561573a044c87a4102522b8fe8432 Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesActionsTest-1611655483 Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesActionsTest-1611655483-project Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 5167ece674de4c11b71bb63db58f9eb3 Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesActionsTest-1611655483-project Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. Sep 12 11:57:03.820651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'f5ee8994-b7f5-47fe-a951-a56dd04180b6'} Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:57:03.821546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. Sep 12 11:57:03.823047 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:03.824961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] Returning 404 to user: Instance f5ee8994-b7f5-47fe-a951-a56dd04180b6 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:57:03.824961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f29c0cf2-f89a-42f2-af98-38144a15709e tempest-VolumesActionsTest-1611655483 tempest-VolumesActionsTest-1611655483-project] 10.222.0.15 "GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6" status: 404 len: 111 microversion: 2.1 time: 0.032796 Sep 12 11:57:03.824961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 292/580] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:03 2022] GET /compute/v2.1/servers/f5ee8994-b7f5-47fe-a951-a56dd04180b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 11:57:04.442681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:04.443379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:04.451732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:04.452259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:04.452736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:04.453539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:04.454151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:04.454920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:04.551914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:04.568185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-200641b3-47cc-490d-8ee2-1cf1a2717875 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1193 microversion: 2.1 time: 0.130388 Sep 12 11:57:04.570969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 289/581] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:04 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:05.597181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:05.597797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:05.604461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:05.604946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:05.605983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:05.606811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:05.607273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:05.607701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:05.668891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:05.676685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4dce76b-f71b-4dbd-8c06-cf092ceb9628 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1211 microversion: 2.1 time: 0.083339 Sep 12 11:57:05.677251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 293/582] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:05 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:06.700962 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:06.701573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:06.707977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:06.708458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:06.708887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:06.709562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:06.710014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:06.710429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:06.838914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:06.846628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-497f0f6b-896a-4b6d-ba49-0b7ad8cb89d1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.150150 Sep 12 11:57:06.847185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 290/583] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:06 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:07.438191 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:07.438744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:07.445294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:07.445780 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:07.446220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:07.446947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:07.447405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:07.447835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:07.471428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7ab0a7e-20ac-4e61-82d8-2fdd867c1c58 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/ips" status: 200 len: 150 microversion: 2.20 time: 0.037193 Sep 12 11:57:07.471976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 294/584] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Sep 12 11:57:07 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 11:57:07.869382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:07.869995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:07.877256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:07.877746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:07.878184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:07.878905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:07.879379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:07.879806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:08.008706 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:08.017056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-031e0ff0-eaac-4706-939d-63322d70790e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.151734 Sep 12 11:57:08.017616 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 291/585] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:07 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:09.039630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:09.040173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:09.047270 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:09.047754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:09.048194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:09.048874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:09.049330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:09.049754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:09.183011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:09.191200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e2bf5c28-c5b5-4a8a-8a38-764529dce4da tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.155411 Sep 12 11:57:09.191875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 295/586] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:09 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:09.944897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14981185-c481-469f-82d7-e05a3cc0ee87", "tag": "1a736c65-ac60-4402-a1ca-e68a2f82f8cf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:09.955041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:09.955514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:09.955937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:09.967182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] Creating event network-changed:1a736c65-ac60-4402-a1ca-e68a2f82f8cf for instance 14981185-c481-469f-82d7-e05a3cc0ee87 on hv-cinder-85331 Sep 12 11:57:09.972328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a6e596ff-96fd-4dea-a1cd-dfef8c1ab5a8 req-0cedee12-3b1e-4c12-b0bf-6716cb12c159 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031286 Sep 12 11:57:09.972935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 292/587] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:10.215040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:10.215643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:10.222029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:10.222584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:10.222973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:10.223653 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:10.224107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:10.224530 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:10.357496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:10.365040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0dd9e7ee-a506-4282-942d-210d784d98a5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.153881 Sep 12 11:57:10.365600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 296/588] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:10 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:11.389255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:11.390004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:11.392019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=60 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:11.397698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:11.398178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:11.398658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:11.399350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:11.399801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:11.400218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:11.602430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:11.610846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f42639ea-9ac1-4df5-a475-27b2d21aceb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.226206 Sep 12 11:57:11.611432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 293/589] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:11 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:12.633087 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:12.633702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:12.636834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:12.637558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:12.643283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:12.643767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:12.644206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:12.644891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:12.645348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:12.645772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:12.775606 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:12.783302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8de6219d-27d5-4f0b-b09d-f1d0b672bac1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.154076 Sep 12 11:57:12.783869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 297/590] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:12 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:13.806536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:13.807190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:13.809145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:13.814912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:13.815644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:13.816069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:13.816744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:13.817195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:13.817612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:13.948255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:13.956755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0c2d498-9e96-449e-93f5-a38033c8f5bc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.154114 Sep 12 11:57:13.957317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 294/591] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:13 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:14.979986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:14.980598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:14.987259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:14.987640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:14.988075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:14.988755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:14.989209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:14.989638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:15.123221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:15.130876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0a369838-dc02-44d7-8eda-d607d5380933 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.154703 Sep 12 11:57:15.131508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 298/592] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:14 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:16.154289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:16.154973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:16.161506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:16.161992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:16.162434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:16.163150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:16.163609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:16.164033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:16.292036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:16.299952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69e85a96-46d4-4403-8222-2e45944bee1c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.149477 Sep 12 11:57:16.300523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 295/593] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:16 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:17.323278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:17.323897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:17.330439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:17.330959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:17.331394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:17.332081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:17.332548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:17.332972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:17.468521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:17.476113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57b3aa14-8f7f-4f51-b0a1-cb7435fb3dfb tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.156631 Sep 12 11:57:17.476670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 299/594] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:17 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:18.167908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:18.168298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:18.175959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:18.176449 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:18.176891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:18.177580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:18.178034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:18.178459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:18.202782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-049915a4-d707-4ef5-8b34-c08a2ded07cd tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.038939 Sep 12 11:57:18.203342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 296/595] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 11:57:18 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:57:18.509029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:18.509864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:18.516921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:18.517549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:18.517981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:18.518697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:18.519310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:18.519912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:18.655043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:18.658377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:18.663364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a1427ad2-6694-4ad4-93f7-d4b6e77dbc3f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.163095 Sep 12 11:57:18.664325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 300/596] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:18 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:19.687061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:19.688635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:19.695992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:19.696499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:19.697101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:19.697944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:19.699456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:19.700184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:19.893697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:19.901681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf56e570-faf1-4c08-b11e-ef0f7e3740c5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.218718 Sep 12 11:57:19.919235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 297/597] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:19 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:20.182900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:20.183877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:20.192114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.192602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.193040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.193734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.194189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.194654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.222006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lazy-loading 'flavor' on Instance uuid c07bfce9-613c-4147-b9c2-47f2ad345dc9 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:57:20.409894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b91c0edc-9028-4b59-8684-3fcc9bbd2178 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/action" status: 202 len: 0 microversion: 2.20 time: 0.237864 Sep 12 11:57:20.414016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 301/598] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 12 11:57:20 2022] POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:57:20.421228 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:20.421867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:20.428097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.428727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.429238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.430102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.431354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.431780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.576881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:20.587127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:20.588637 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:20.589953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0a48339-87fd-4206-9d2c-e23e2145d6e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.174547 Sep 12 11:57:20.590707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 298/599] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:20 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:20.748782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f980fc91-856a-4afc-9e51-63addea8e5e9"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:20.758615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:20.766752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.767589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.768355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.769303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.769931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.770585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.935662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:20.938664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:20.952425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.953391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.954252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:20.955055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:20.955833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:20.956423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:21.139914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:21.148614 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-839c7929-1e0a-4cc9-a2a3-58063c7f66c8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.222892 Sep 12 11:57:21.149522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 299/600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:20 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:21.615371 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:21.615975 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:21.621839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:21.622323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:21.622795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:21.623476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:21.623929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:21.624357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:21.641968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:21.753520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:21.762235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:21.764342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:21.765498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d22dce7-0c4a-4989-98e0-d6ff13e3fe0b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.154076 Sep 12 11:57:21.766066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 300/601] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:21 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:57:22.173467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:22.174174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:22.180374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:22.180850 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:22.181281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:22.181998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:22.182447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:22.182893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:22.315763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:22.323230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57e25bfb-0e67-4626-b4bd-126eaa72aee8 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.153738 Sep 12 11:57:22.323819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 301/602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:22 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:22.794153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:22.794787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:22.800651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:22.801125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:22.801560 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:22.802238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:22.802726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:22.803147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:22.942148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:22.950241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:22.951708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:22.952857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5689f780-38ba-48af-b4ac-44d7e77df0ac tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.163373 Sep 12 11:57:22.953408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 302/603] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:22 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:57:23.155694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ee2a0e3-0a5a-4835-980e-b78727cc7ba0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.412396 Sep 12 11:57:23.156294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 302/604] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:57:20 2022] POST /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments => generated 194 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:23.345643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:23.346242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:23.352570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:23.353057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:23.353494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:23.354171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:23.354672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:23.355617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:23.489249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:23.497726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7606685a-ea80-4846-928e-8fdbb1685e7b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.156025 Sep 12 11:57:23.498289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 303/605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:23 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:23.979452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:23.980761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:23.986901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:23.987383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:23.987819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:23.988504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:23.988961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:23.989388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:24.122346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:24.130397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:24.131881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:24.133032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-39f46a56-4de5-4786-844f-aba717bb5b15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.158510 Sep 12 11:57:24.133584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 303/606] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:23 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:24.520681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:24.521290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:24.527731 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:24.528207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:24.528634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:24.529343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:24.529792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:24.530211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:24.660184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:24.668274 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-569d2a44-ee7f-4da2-a6ac-0996a722b464 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.151401 Sep 12 11:57:24.668836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 304/607] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:24 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:25.159043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:25.159660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:25.166090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:25.166603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:25.167044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:25.168444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:25.168900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:25.169328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:25.295645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:25.303602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:25.305049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:25.306194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-01dcdf20-3105-429c-9eb3-af71c0ce21f2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.151081 Sep 12 11:57:25.306778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 304/608] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:25 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:25.691889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:25.693181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:25.703669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:25.704732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:25.705645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:25.707029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:25.707750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:25.708932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:25.871920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:25.884604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2790a538-ff95-40d0-91be-0739d67cbf5b tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.196878 Sep 12 11:57:25.901236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 305/609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:25 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:26.332497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:26.333859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:26.349607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:26.350147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:26.350648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:26.351464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:26.352509 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:26.353104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:26.518833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:26.527525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:26.528960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:26.530105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8d806ad1-5e03-4f4e-b6f4-3a198c0ff4c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.201695 Sep 12 11:57:26.530987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 305/610] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:26 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:26.912164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:26.912876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:26.920419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:26.920906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:26.921341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:26.922075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:26.922553 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:26.923002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:27.085644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:27.097942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab8293e2-2bb7-410d-9b67-b404bc21dd7d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.190809 Sep 12 11:57:27.099290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 306/611] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:26 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:27.555644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:27.556294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:27.563610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:27.564095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:27.564523 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:27.565461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:27.565905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:27.566322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:27.724895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:27.735675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:27.737426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:27.738928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-40ee4db2-a2c8-451f-813e-d5bd745f1991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.187137 Sep 12 11:57:27.740051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 306/612] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:27 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:28.124262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:28.124853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:28.131219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:28.131699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:28.132134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:28.132810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:28.133264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:28.133686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:28.263271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:28.270778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c65cdf4-8fc6-4b82-8fbb-f6e0f545974a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.150579 Sep 12 11:57:28.271332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 307/613] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:28 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:28.768900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:28.770187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:28.778442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:28.779196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:28.779887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:28.780759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:28.781488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:28.782066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:28.940547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:28.949302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:28.951241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:28.952684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd7b05d4-b3ad-4539-b26e-96ba9a4952a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.188555 Sep 12 11:57:28.953755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 307/614] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:28 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:57:29.293472 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:29.295105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:29.303428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:29.304090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:29.304691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:29.305578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:29.306302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:29.307127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:29.474302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:29.482877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca724f94-006b-4b53-a44d-d878b432deb9 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1278 microversion: 2.1 time: 0.193698 Sep 12 11:57:29.483748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 308/615] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:29 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:29.980136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:29.981315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:29.991033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:29.992109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:29.992544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:29.993486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:29.994159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:29.994715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:30.168550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:30.179824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:30.182013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:30.184381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9d4cd549-46f4-4909-84db-7e7e04131674 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.208680 Sep 12 11:57:30.185654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 308/616] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:29 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:30.517676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:30.520023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:30.528886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:30.530281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:30.531229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:30.532205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:30.532875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:30.533749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:30.701598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:30.709486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-685f16ca-8616-40ac-9492-bd318f70d338 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.196307 Sep 12 11:57:30.710047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 309/617] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:30 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:31.210778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:31.211535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:31.219051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:31.219567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:31.220218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:31.220908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:31.221355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:31.221776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:31.378748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:31.388910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:31.390681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:31.391843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e1e84eac-3d0d-48ab-bb61-b11fde79a2f1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.184989 Sep 12 11:57:31.392495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 309/618] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:31 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:31.735201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:31.750547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:31.757537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:31.758254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:31.758968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:31.759639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:31.760154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:31.761063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:31.930160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:31.939269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c01a27c-72b8-4f51-ab07-6343e6086233 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.207953 Sep 12 11:57:31.940357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 310/619] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:31 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:32.423058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:32.424898 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:32.433655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:32.437915 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:32.438783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:32.440560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:32.441658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:32.442387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:32.614669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:32.624233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:32.625671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:32.626847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-25b7a5eb-0d98-45fb-a5ae-37540b6bc6df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.208399 Sep 12 11:57:32.627393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 310/620] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:32 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:32.963346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:32.964602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:32.971493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:32.971981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:32.972414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:32.973103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:32.973643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:32.974203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:33.134158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:33.142743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da515bdd-c413-4fab-b54b-8cc5efaf798e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.183120 Sep 12 11:57:33.143329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 311/621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:32 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:33.653673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:33.654549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:33.656921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=42 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:33.662409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:33.663118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:33.663719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:33.664408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:33.664856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:33.665274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:33.799518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:33.808180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:33.809722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:33.811202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bc37068-ebcd-41ee-a04f-9b8be6f89608 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.161406 Sep 12 11:57:33.839641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 311/622] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:34.166981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:34.168416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:34.175781 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:34.180787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:34.181469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:34.182818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:34.183476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:34.184125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:34.355297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:34.367273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-559cd992-26e0-45cd-9195-84218fbb3af4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.204051 Sep 12 11:57:34.367702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 312/623] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:34 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:34.839949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:34.840613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:34.847777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:34.848350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:34.848995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:34.849738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:34.850195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:34.850660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:34.989395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:34.998485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:35.000765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:35.003439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e214e9cc-f602-49be-9e0c-a76a9d1aa342 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.166770 Sep 12 11:57:35.005091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 312/624] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:34 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:35.391902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:35.392543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:35.399005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:35.399475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:35.399910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:35.400594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:35.401058 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:35.401491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:35.560405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:35.570561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7fdf357-87c5-4c9b-971f-d291dabfc79d tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.182344 Sep 12 11:57:35.571746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 313/625] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:35 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:36.030081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:36.030747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:36.036934 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.037412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.037850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.038565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.039025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.039446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.179581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:36.188300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:36.189988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:36.191164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f67053a9-cc49-4a48-9d8f-c0c8737e81bd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.165846 Sep 12 11:57:36.191715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 313/626] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:36 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:36.597452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:36.599028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:36.607288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.607995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.608660 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.609524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.610119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.610761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.798730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:36.807520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8950422c-45e7-4b83-ad64-99ddc9201c27 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.213895 Sep 12 11:57:36.810247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 314/627] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:36 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:36.844390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:36.844972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:36.851471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.851886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.852558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.853267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:36.853975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:36.854610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:36.884968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:37.020583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lazy-loading 'services' on Instance uuid 0091a504-f12a-4e6c-81fa-fbffd4805e6c {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:57:37.179870 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6a4bdaa-67a3-4cd9-8cef-59cf7b3d4a8d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c/os-volume_attachments/7e87a15c-877b-4f30-92d9-27a33931a063" status: 202 len: 0 microversion: 2.1 time: 0.340790 Sep 12 11:57:37.180612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 314/628] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 11:57:36 2022] DELETE /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c/os-volume_attachments/7e87a15c-877b-4f30-92d9-27a33931a063 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:57:37.218316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:37.219597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:37.228190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:37.229522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:37.230252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:37.231723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:37.232500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:37.233148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:37.539561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:37.551285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:37.552744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:37.554813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2c4bc13-a059-4f6a-b3aa-d426c15ed84a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.341044 Sep 12 11:57:37.556453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 315/629] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:37 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:37.833527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:37.834678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:37.845079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:37.845932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:37.847469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:37.848216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:37.848684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:37.849123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:38.085215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:38.098568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4cb37ed5-1b83-440a-bc53-8a790d04391c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.268629 Sep 12 11:57:38.106895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 315/630] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:37 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:38.581474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:38.582048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:38.589534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:38.590046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:38.590490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:38.591213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:38.591668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:38.592109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:38.749833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:38.758016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:38.759734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:38.761147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef63a5d2-b7bb-47ed-9dbc-4ad38209e44f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.183717 Sep 12 11:57:38.761784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 316/631] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:38 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:39.124376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:39.124992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:39.131245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:39.131969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:39.132596 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:39.133297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:39.133916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:39.134543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:39.276652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:39.287062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3dda1b12-cc64-4c49-a7ac-060bfba3b501 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.166646 Sep 12 11:57:39.288094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 316/632] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:39 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:39.789039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:39.790470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:39.798002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:39.798768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:39.800149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:39.800804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:39.801253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:39.801846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:39.806218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:39.971414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:39.981123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:39.982743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:39.984032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77ea158a-4218-4d4b-a043-10427c77cbb2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.199005 Sep 12 11:57:39.984691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 317/633] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:39 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:40.315332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:40.316626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:40.323544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:40.324100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:40.324701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:40.326094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:40.326797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:40.327398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:40.505033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:40.517224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a59be49b-7235-40b4-826f-d531297ded53 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.206270 Sep 12 11:57:40.518603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 317/634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:40 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:41.011981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:41.013550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:41.021605 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:41.022103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:41.022619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:41.024021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:41.024760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:41.025345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:41.175310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:41.184450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:41.186795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:41.188733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e491b288-f063-49e8-98a9-7c9a0ee7ac15 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.180925 Sep 12 11:57:41.190453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 318/635] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:41 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:41.542489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:41.543217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:41.550069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:41.550757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:41.551533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:41.552317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:41.552852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:41.554760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:41.703127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:41.711635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-948577c5-4742-4b0e-9538-1ed51a942276 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.174095 Sep 12 11:57:41.712196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 318/636] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:41 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:42.217575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:42.218174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:42.220577 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=52 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:42.225903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:42.226376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:42.226828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:42.227503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:42.227947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:42.228382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:42.359731 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:42.367889 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:42.369286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:42.370482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d664597-9029-4b04-86b4-cd9069359181 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.157362 Sep 12 11:57:42.371059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 319/637] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:42 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:42.734861 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:42.735460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:42.741802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:42.742266 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:42.742736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:42.743411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:42.743859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:42.744351 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:42.875397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:42.883407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c99ab172-08a5-4d67-8fb9-2549f6c3fdd5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.152350 Sep 12 11:57:42.883973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 319/638] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:42 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:43.396388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:43.396923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:43.404004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:43.404496 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:43.404933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:43.405713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:43.406180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:43.406637 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:43.552544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:43.561174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:43.562656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:43.563814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a6039db-52e6-4271-817e-39184226c0cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.171938 Sep 12 11:57:43.564626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 320/639] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:43 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:43.906960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:43.907493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:43.914005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:43.914467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:43.914938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:43.915619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:43.916075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:43.916499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:44.295077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:44.302556 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dfd1b790-7de9-491b-82c0-315ab10ca4ff tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.399406 Sep 12 11:57:44.303124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 320/640] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:43 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:44.591240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:44.592116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:44.599147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:44.599590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:44.600041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:44.600725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:44.601179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:44.601633 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:44.661954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9af41703-1cba-46ac-926d-bfbafc8a6b97 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: .version_select at 0x7fc93a4a6ee0>, body: {"keypair": {"name": "tempest-keypair-2053704745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8eaEL3hxStfDLu8ED/UyG3iSTHsUiPA8V7omzrjhHlgU0wL7ZV64VdUeA+QiYPboOz+Tvayu/A+wmAy6oRhU7BZUVKEzSr/Tss4clwA5GtAm3nVfKlHQuxYuhdke1fvA=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:44.677617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9af41703-1cba-46ac-926d-bfbafc8a6b97 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:57:44.682472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9af41703-1cba-46ac-926d-bfbafc8a6b97 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:57:44.711818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9af41703-1cba-46ac-926d-bfbafc8a6b97 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053516 Sep 12 11:57:44.714564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 321/641] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 11:57:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:57:44.789747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:44.799330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:44.801404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:44.802882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed786f95-33bc-4dc9-90e0-d697cc5dd991 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.216028 Sep 12 11:57:44.816151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 321/642] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:44 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:45.326984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:45.327637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:45.334855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.335725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.336161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.337027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.337629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.339307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.581260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:45.590020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5d8b63e6-2877-48a1-8dea-1b01c2e89137 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.268316 Sep 12 11:57:45.592345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 322/643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:45 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:45.831872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:45.832466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:45.846794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.846794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.846794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.846794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.847115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.847115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.858945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:45.860081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:45.868433 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.869339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.870543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.872648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:45.873500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:45.874134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:45.920093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:57:46.013286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:46.024156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:46.026691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:46.028116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02ffcc0b-be78-4cbc-a40e-3a03f7bc379b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.200044 Sep 12 11:57:46.029578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 322/644] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:45 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:46.051809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-409f4165-15a5-49cb-9548-66a0e8e6471d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 204 len: 0 microversion: 2.1 time: 0.197992 Sep 12 11:57:46.053083 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 323/645] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:57:45 2022] DELETE /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:57:46.079616 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:46.080468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:46.095917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:46.096730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:46.099004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:46.099988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:46.101961 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:46.102494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:46.285077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:46.293508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e8d2df5-c415-44a5-a211-1fa21f9e9f1e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1515 microversion: 2.1 time: 0.230367 Sep 12 11:57:46.294332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 323/646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:46 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:46.468542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1703171923", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea7071fe-73d4-4a9c-bf82-37346c7e58c4"}], "security_groups": [{"name": "tempest-securitygroup--790614075"}], "key_name": "tempest-keypair-2053704745", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:46.576011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] validate_networks() for [('ea7071fe-73d4-4a9c-bf82-37346c7e58c4', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:57:46.614906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:46.615994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:46.622964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:46.623672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:46.624201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:46.625044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:46.625647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:46.626175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:46.768837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:46.778197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-804ff3cd-ba93-457d-b0cc-4c7b5b364a86 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.167249 Sep 12 11:57:46.779129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 324/647] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:46 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:46.995277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:57:46.995702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:57:46.996173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:57:46.996583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:57:46.996996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:57:47.007719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.008204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.008639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.009585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.010657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.011135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.029145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:57:47.033374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:57:47.045149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:57:47.047722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:57:47.056609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:47.057666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:47.065663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.066142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.066644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.067361 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.068197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.068625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.105249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7963084-1e29-4151-b459-11398514fc15 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641747 Sep 12 11:57:47.112870 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 324/648] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:57:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:57:47.117817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e6830262-5978-4f6a-8192-82678c92a06c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:47.118429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e6830262-5978-4f6a-8192-82678c92a06c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:47.201751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6830262-5978-4f6a-8192-82678c92a06c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.216786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e6830262-5978-4f6a-8192-82678c92a06c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1242 microversion: 2.1 time: 0.102283 Sep 12 11:57:47.232237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 325/649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:47 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:47.240410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.254951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.257754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.259603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05da0f1c-362d-4a85-b8f8-ee5b70e914f3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.207083 Sep 12 11:57:47.263069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 325/650] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:47 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:57:47.319848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:47.320459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:47.326738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.327626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.328374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.329613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.330214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.331125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.517346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.529807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ba326732-d314-43cd-9b67-f5229a8f25cd tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1515 microversion: 2.1 time: 0.214659 Sep 12 11:57:47.530357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 326/651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:47 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:47.804112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:47.804112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:47.810121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.810645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.811105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.811790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:47.812247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:47.812669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:47.969073 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:47.979318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4150d3c3-8b0c-4e54-85f0-03b999df4703 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.179592 Sep 12 11:57:47.980384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 326/652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:47 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:48.243284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:48.244251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:48.261556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14981185-c481-469f-82d7-e05a3cc0ee87", "name": "network-vif-plugged", "status": "completed", "tag": "1a736c65-ac60-4402-a1ca-e68a2f82f8cf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:48.273677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.274187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.276907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.281926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.282417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.284805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.292004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.292494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.293739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.321337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] Creating event network-vif-plugged:1a736c65-ac60-4402-a1ca-e68a2f82f8cf for instance 14981185-c481-469f-82d7-e05a3cc0ee87 on hv-cinder-85331 Sep 12 11:57:48.330104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a1d84236-c403-4607-97a7-7ce60dba3889 req-2e68de76-e24a-48d7-8738-2b71c619f9a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073843 Sep 12 11:57:48.333650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 327/653] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:48.349284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:48.350067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:48.379386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.380296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.380888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.381858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.382465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.383057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.409176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:48.421522 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5e60f2e3-1f10-4116-972b-4fe81bc773a6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1294 microversion: 2.1 time: 0.183061 Sep 12 11:57:48.422367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 327/654] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:48 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1294 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:48.555191 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:48.557071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:48.564479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:48.574690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:48.576187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:48.577348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6ddef3f-8786-4a2b-8e3c-34856a2962b2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.242453 Sep 12 11:57:48.577907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 328/655] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:48 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:48.594465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.596138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.596772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.597689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:48.598178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:48.599197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:48.736226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:48.745972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1d2195aa-14c1-4369-a14e-90b21e9a91c8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1515 microversion: 2.1 time: 0.194271 Sep 12 11:57:48.746698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 328/656] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:48 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:49.002821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:49.003432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:49.010077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.010658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.011101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.011799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.012433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.012867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.227868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.235715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80a0efc4-f8ef-4a42-899c-796ce0a75ffc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.236739 Sep 12 11:57:49.236283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 329/657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:48 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:49.445503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:49.446143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:49.447536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0091a504-f12a-4e6c-81fa-fbffd4805e6c", "name": "network-vif-deleted", "tag": "97caae66-7f53-4c32-88b7-4710eddd6d85"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:49.453288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.453782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.454221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.454935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.455393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.456017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.457490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.458033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.458544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.470161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] Creating event network-vif-deleted:97caae66-7f53-4c32-88b7-4710eddd6d85 for instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c on hv-cinder-85331 Sep 12 11:57:49.475480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-117f6bf6-d767-4841-b82b-9e85a789d312 req-6b1135cd-4aab-455e-937c-4412358f388c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Sep 12 11:57:49.476093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 330/658] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:57:49.521755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.529546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4f6ae3d2-f54b-4c75-b7f8-0b7c88a8a754 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1302 microversion: 2.1 time: 0.087983 Sep 12 11:57:49.530118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 329/659] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:49 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:49.604546 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:49.605232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:49.611313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.611814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.612239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.612909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.613357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.613774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.739098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.747806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.749236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.750384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86c29db9-90b8-4a6c-917c-53ad789bf196 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.150748 Sep 12 11:57:49.750988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 331/660] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:49 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:49.769055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:49.769679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:49.776001 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.776465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.776888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.777561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:49.778006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:49.778425 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:49.844301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:49.852536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-55d76cf9-5725-412e-9673-b66e7b644025 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1473 microversion: 2.1 time: 0.087291 Sep 12 11:57:49.853155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 330/661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:49 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1473 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:50.259038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:50.259684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:50.266147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.266663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.267105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.267788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.268247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.268674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.350551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "name": "network-vif-plugged", "status": "completed", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:50.360082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.360552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.360973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.365104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:50.372967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] Creating event network-vif-plugged:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:57:50.378210 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e57639f4-c42e-4410-8650-267ec0049b51 req-2a162d50-8469-4907-b15d-d427d062589c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Sep 12 11:57:50.378845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 331/662] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:57:50.399986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:50.408262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e4605bb-c90e-4573-a72b-bf65708d667e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1266 microversion: 2.1 time: 0.153080 Sep 12 11:57:50.408817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 332/663] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:50 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:50.553576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:50.554260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:50.561566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.562577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.563008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.563682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.564382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.564797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.627036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:50.634799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-311df554-bf08-4d98-b265-edb0a8ca59ae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1302 microversion: 2.1 time: 0.085382 Sep 12 11:57:50.635359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 332/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:50 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:50.775530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:50.776611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:50.784061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.784712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.785250 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.786416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.787025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.787772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.876677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:50.877368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:50.884129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.884776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.885319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.886120 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.886864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.887367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.926724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:50.927424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:50.927721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:50.928352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lazy-loading 'fault' on Instance uuid 0091a504-f12a-4e6c-81fa-fbffd4805e6c {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:57:50.991653 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.002727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c7e758f7-b9f2-4c39-92dd-68d86cc34d7e tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1309 microversion: 2.1 time: 0.130558 Sep 12 11:57:51.003595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 333/665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:50 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:51.017787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-813021334", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:51.049372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.058396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.059954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.061289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b121f6d3-7e21-4493-bba9-9f625df4dc5c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1742 microversion: 2.20 time: 0.289627 Sep 12 11:57:51.062932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 333/666] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:50 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1742 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:51.074338 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] validate_networks() for None {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:57:51.375170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:57:51.375637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:57:51.376106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:57:51.377115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:57:51.377537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:57:51.386997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.387480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.388182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.388630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.389082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.389504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.407399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Getting quotas for project e6edca5cca3e43e8835b6382e2d5ec1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:57:51.411449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Getting quotas for user f2faaf7fcb0142b6b7aeb68f7e675e33 and project e6edca5cca3e43e8835b6382e2d5ec1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:57:51.423049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:57:51.425343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:57:51.430908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:51.431510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:51.437754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.438233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.438691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.439816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.440269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.440690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.472352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e21c2b11-16c9-4890-8244-da54c2d6cbba tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.460457 Sep 12 11:57:51.473762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 334/667] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 11:57:51.486043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f12647eb-a1bc-4214-8878-3095849a8b19 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:51.486688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f12647eb-a1bc-4214-8878-3095849a8b19 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:51.502757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:51.555387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f12647eb-a1bc-4214-8878-3095849a8b19 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.563677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f12647eb-a1bc-4214-8878-3095849a8b19 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1214 microversion: 2.1 time: 0.082378 Sep 12 11:57:51.570592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 335/668] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:51 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:51.658836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:51.659552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:51.666774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.667330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.667907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.668698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.669157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.669579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.670129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.682494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-590f75cd-9442-4bc1-a82c-1ad620fe82be tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1453 microversion: 2.1 time: 0.254820 Sep 12 11:57:51.683932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 334/669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:51 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:51.721372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:51.723799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:51.740357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.741047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.741655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.742721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:51.745124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:51.745755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:51.757158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:57:51.772012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:51.786640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d8536ecc-3909-4ac7-9718-fcc00100418c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1300 microversion: 2.1 time: 0.132223 Sep 12 11:57:51.787778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 336/670] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:51 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:52.030030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:52.032285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:52.035896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.039983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.040468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.040928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.042478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.043531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.043982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.061698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe3ae6f7-1b91-4f83-8995-03c4d3b5f949 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1453 microversion: 2.1 time: 0.358947 Sep 12 11:57:52.065259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 335/671] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:51 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1453 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:52.088601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:52.089701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:52.101567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.102069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.102503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.103231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.103854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.104434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.111412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.113551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.114687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.115378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lazy-loading 'fault' on Instance uuid 0091a504-f12a-4e6c-81fa-fbffd4805e6c {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:57:52.163217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.172542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-29fd829f-ecca-49f4-ad11-b4d257f2bf51 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 200 len: 1309 microversion: 2.1 time: 0.151060 Sep 12 11:57:52.173854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 337/672] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:52 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:52.358229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.370137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.371868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.373033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9faaf13a-4acc-4af0-99e0-c5ac120f7993 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.288508 Sep 12 11:57:52.373764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 336/673] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:52 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:52.592416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:52.594027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:52.614867 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.615450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.616009 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.616642 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.617084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.617616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.748516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:52.759537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c918d7f-17b2-4bca-8659-e8390825ba07 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1266 microversion: 2.1 time: 0.174374 Sep 12 11:57:52.774975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 338/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:52 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:52.813618 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:52.814719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:52.826137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.827044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.829003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:52.829986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:52.830841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:52.831808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.200575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:53.201185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 0091a504-f12a-4e6c-81fa-fbffd4805e6c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:53.208629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.209122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.209549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.210249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.217981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.220373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.231971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:53.248165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-903efcf0-f5f3-4118-87cf-227f4cc8b43d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.440995 Sep 12 11:57:53.252544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 337/675] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:52 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:53.258579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] HTTP exception thrown: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Request method failure captured: Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c HTTP/1.1 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx415kpFjXqoXtBMijtT-z30yzYhX-bpjlnI5J37yB7Ve5YpB9hRCLI0TFOjEBzet01_D1m66LzTmlbpi6QZJNl_syjAoNpOUiDEMKYPmrXd6HWD70wOLv0P7u464RZbMnl8hYwAfqvNnc_K_8a69G_i5L2dsekV5Joa9qojTE4TEno Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: ad01763b3d76492598530234d3b75ec8 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 11:57:53.260485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad01763b3d76492598530234d3b75ec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad01763b3d76492598530234d3b75ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad01763b3d76492598530234d3b75ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad01763b3d76492598530234d3b75ec8"}]}] Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: ad01763b3d76492598530234d3b75ec8 Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesSnapshotTestJSON-2100038787-project Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f4b71a4e5c1a4656a541f9cacec0af18 Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesSnapshotTestJSON-2100038787-project Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. Sep 12 11:57:53.262202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '0091a504-f12a-4e6c-81fa-fbffd4805e6c'} Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:57:53.263218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. Sep 12 11:57:53.265224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 11:57:53.267050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Returning 404 to user: Instance 0091a504-f12a-4e6c-81fa-fbffd4805e6c could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:57:53.267050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1a027fc5-bee0-419c-83b2-372f388f4b83 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c" status: 404 len: 111 microversion: 2.1 time: 0.065731 Sep 12 11:57:53.267050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 339/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:53 2022] GET /compute/v2.1/servers/0091a504-f12a-4e6c-81fa-fbffd4805e6c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 11:57:53.346462 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b230ba8-8256-43a9-ba1d-bd1167fd36bf", "tag": "9cab3842-6521-4349-b9ee-73997786a3bf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:53.377668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.380734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.381653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.399914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:53.400812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:53.418471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.429496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.430033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.430840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.435878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.437353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.443365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] Creating event network-changed:9cab3842-6521-4349-b9ee-73997786a3bf for instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf on hv-cinder-85331 Sep 12 11:57:53.465184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d51539c7-96ac-460b-9268-f0e19f1c9c20 req-16f6c9a8-b4d7-4e1c-8115-103a9e2bf3c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129702 Sep 12 11:57:53.471348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 338/677] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 12 11:57:53.787453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:53.788437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:53.799033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.803125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.803794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.804680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:53.807555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:53.808181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:53.972884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:53.982043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3ef7e4a-d0c5-46d8-b074-e9af16b1c9fe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1284 microversion: 2.1 time: 0.200092 Sep 12 11:57:53.983104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 339/678] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:53 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:57:54.034477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:54.055519 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:54.058369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:54.060398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0163d3a-00e9-4c83-b986-145587dfcd48 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.664382 Sep 12 11:57:54.061183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 340/679] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:53 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:57:54.281166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:54.281939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:54.289874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:54.290782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:54.291369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:54.292372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:54.293083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:54.293721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:54.456659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:54.469685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bcc3bfae-0192-40a8-bb2b-c721a2526fce tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.194695 Sep 12 11:57:54.470582 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 340/680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:54 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:54.887665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14981185-c481-469f-82d7-e05a3cc0ee87", "tag": "1a736c65-ac60-4402-a1ca-e68a2f82f8cf"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:57:54.902173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:54.903020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:54.903683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:54.918770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] Creating event network-changed:1a736c65-ac60-4402-a1ca-e68a2f82f8cf for instance 14981185-c481-469f-82d7-e05a3cc0ee87 on hv-cinder-85331 Sep 12 11:57:54.925015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-d61cdb3b-8c84-4a53-91d3-b7fda63839ab req-662c8378-febe-46e7-bfe2-f7bc629dd832 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040748 Sep 12 11:57:54.929814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 341/681] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:57:55.007587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:55.008707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:55.016370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.017194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.017861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.030759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.031646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.032344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.097167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:55.097864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:55.106679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:55.109612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.116350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2b62ee6-9393-406d-aa6d-512abf6dc9f7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1272 microversion: 2.1 time: 0.113603 Sep 12 11:57:55.117663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 341/682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:55 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:55.126879 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.127694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.128815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.129502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.130344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.301873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:55.313298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:55.315072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:55.317624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78b6b0b4-584f-4770-b067-ad873842c5b0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.225248 Sep 12 11:57:55.334254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 342/683] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:55 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:55.493288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:55.493808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:55.500652 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.501117 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.501555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.502256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:55.502972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:55.503403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:55.731943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:55.748669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ca2ae23-d0f6-4e6e-b8fc-1d36fb9defbc tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.258840 Sep 12 11:57:55.749702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 342/684] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:55 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:56.144562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:56.145945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:56.153652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.154561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.155094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.156095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.156761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.157248 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.241771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:56.253177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2afd17d1-6d71-4f35-8d7c-573d85e33b0a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1272 microversion: 2.1 time: 0.113854 Sep 12 11:57:56.267474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 343/685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:56 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:56.352669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:56.353381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:56.363722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.364233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.364981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.367900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.368727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.369545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.550442 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:56.558946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:56.560622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:56.562535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1cfd3d62-ef90-4adf-9fa2-f8bb4a10f624 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.219124 Sep 12 11:57:56.578944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 343/686] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:56 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:56.781121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:56.782164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:56.793039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.793714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.794558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.795432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:56.796508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:56.797014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:56.948443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:56.958876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f4a5590-f9b4-4274-bdba-a1459b045701 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.182086 Sep 12 11:57:56.959620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 344/687] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:56 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:57.279234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:57.281941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:57.288447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.289178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.289781 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:57.290810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.291295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.291723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:57.364228 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:57.376095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f97b420-56e7-46f9-85ce-b25f9ba64f81 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1272 microversion: 2.1 time: 0.100938 Sep 12 11:57:57.376684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 344/688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:57 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:57.589533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:57.590362 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:57.597851 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.598416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.599112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:57.599828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.600352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.600783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:57.752043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:57.761794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:57.763253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:57.764410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-077f38f8-d0db-4d73-874c-a53f7496d876 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.179149 Sep 12 11:57:57.777409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 345/689] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:57 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:57.982777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:57.984875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:57.991177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.992135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.992899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:57.993830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:57.994354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:57.994886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:58.147893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:58.157902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-803f25df-40f2-4cd1-b747-715606f1ef19 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.179334 Sep 12 11:57:58.159786 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 345/690] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:57 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:58.401360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:58.401963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:58.409315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:58.409315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:58.409315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:58.409929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:58.410150 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:58.410596 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:58.495232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:58.505174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-419eaa55-e8b5-4633-8fb5-85c0d6dfedcb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1272 microversion: 2.1 time: 0.107380 Sep 12 11:57:58.521146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 346/691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:58 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:58.793980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:58.794945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:58.803596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:58.806768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:58.807461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:58.808497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:58.809167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:58.809988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:59.004252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:59.020169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:59.021586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:59.022759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ef7e3a7-7293-4a9d-a68f-c9aaa0878523 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.235678 Sep 12 11:57:59.036216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 346/692] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:57:58 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:57:59.181558 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:59.182134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:59.190409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:59.191014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:59.191690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:59.192418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:59.192884 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:59.193318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:59.343489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:59.364304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0ca106a5-1207-4e2a-8348-e36f834deffb tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.186687 Sep 12 11:57:59.364909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 347/693] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:59 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:57:59.531504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:57:59.532029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:57:59.538219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:59.538745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:59.539187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:59.539892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:57:59.540349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:57:59.540778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:57:59.692568 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:57:59.700139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16c291d5-2e89-4b11-88bb-01f57dd04073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.175809 Sep 12 11:57:59.701011 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 347/694] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:57:59 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:00.049670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:00.050371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:00.057181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.057676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.058114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.059135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.059750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.060758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.227826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:00.237713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:00.239386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:00.240553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06a5b8cf-5b64-4f5d-abe3-1657c0a83d65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.195031 Sep 12 11:58:00.242889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 348/695] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:00 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:00.389280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:00.390564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:00.411480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.412424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.413215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.414222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.415156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.415811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.704987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:00.715251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b71e090-a02e-4909-a423-85cb5e7d46e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.330892 Sep 12 11:58:00.716398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 348/696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:00 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:00.729683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:00.730297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:00.737941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.738768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.739423 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.740125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:00.740580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:00.741008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:00.894447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:00.902727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2026fe1d-d7cc-4d69-bda7-a78b1d37bfbc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.177297 Sep 12 11:58:00.903427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 349/697] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:00 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:01.268863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:01.269704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:01.276654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.277375 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.277987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:01.279305 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.279974 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.280574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:01.447418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:01.462579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:01.464005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:01.465218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e7cde2e-288c-4cfd-a3d1-cfa9e59c44cc tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.201667 Sep 12 11:58:01.465775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 349/698] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:01 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:01.744436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:01.745122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:01.748573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:01.749988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=20 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:01.755637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.756394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.757074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:01.757778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.758237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.758704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:01.918331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:01.923071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:01.928538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:01.928771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-654a6584-c8e5-414b-8336-913d97f5d9af tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.190235 Sep 12 11:58:01.929139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 350/699] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:01 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:01.929288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:01.935432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.936758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.937236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:01.937967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:01.938431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:01.939164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:02.093329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:02.101697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b68b8cbe-f795-4d59-8845-f3be3613b9cb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.177271 Sep 12 11:58:02.102583 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 350/700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:01 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:02.491042 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:02.491513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:02.498958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:02.499578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:02.500024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:02.500720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:02.501180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:02.501610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:02.715130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:02.723863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:02.725300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:02.726450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c66f482d-f0c9-4c4b-880d-9da6de1eb966 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.239826 Sep 12 11:58:02.727316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 351/701] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:02 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:02.953584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:02.954132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:02.960651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:02.961141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:02.961583 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:02.962271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:02.962765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:02.963194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:03.091760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:03.100266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-736baa3b-c5cc-4abf-b9b6-c98262c31c80 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.151759 Sep 12 11:58:03.100843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 351/702] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:02 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:03.124913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:03.125522 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:03.132512 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:03.132989 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:03.133424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:03.134102 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:03.134586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:03.135012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:03.261020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:03.269091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9c562753-3110-4203-b21b-fb279b97e7ab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.147985 Sep 12 11:58:03.269653 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 352/703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:03 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:03.754663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:03.755208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:03.761134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:03.761616 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:03.762054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:03.762917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:03.763378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:03.763808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:03.781185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:03.894893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:03.902901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:03.904348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:03.906005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b3f5305-03e3-4895-85c7-9bb86631eed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.155360 Sep 12 11:58:03.906579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 352/704] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:03 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:04.124516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:04.125202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:04.131420 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.131901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.132336 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:04.133028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.133482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.133909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:04.265925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:04.274160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-00222eb2-3ed0-48aa-a68e-7ccdbc02f357 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.155012 Sep 12 11:58:04.274762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 353/705] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:04 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:04.291578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:04.292275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:04.299992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.300511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.300959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:04.301858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.302310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.302765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:04.430658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:04.438225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a37ad5eb-300e-44a5-9363-1b3f207be6db tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.150488 Sep 12 11:58:04.439072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 353/706] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:04 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:04.931742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:04.932379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:04.938339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.939101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.939536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:04.940211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:04.940662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:04.941085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:05.073734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:05.082352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:05.083845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:05.085019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e1a66685-fc80-4c67-b18b-9b48db941944 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.157198 Sep 12 11:58:05.085584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 354/707] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:04 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:05.298401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:05.298965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:05.305279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:05.305765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:05.306208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:05.306938 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:05.307396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:05.307828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:05.441188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:05.449008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b24b30fb-c5d1-4a8a-a6bd-fd6c42be3e6d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.155149 Sep 12 11:58:05.449581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 354/708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:05 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:05.466108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:05.466755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:05.474437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:05.475159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:05.475595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:05.476292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:05.476744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:05.477165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:05.708943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:05.722245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f992445-5173-4b78-a52c-46f79525eb3d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.264833 Sep 12 11:58:05.735114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 355/709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:05 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:05.753693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2143257853", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "networks": [{"uuid": "190ca13d-23a4-4727-abc0-c0a3ec2ef0b1"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:05.812023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] validate_networks() for [('190ca13d-23a4-4727-abc0-c0a3ec2ef0b1', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 11:58:06.111561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:06.112437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:06.120139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.120794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.121403 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.122274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.122916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.124452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.326237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.337926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.339796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.341331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a35ba13a-a101-4191-9d71-d4f61035b046 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1737 microversion: 2.20 time: 0.234451 Sep 12 11:58:06.342875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 356/710] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:06 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:06.371498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e94a234-87f5-4731-aca7-9d97d53b48e1", "tag": "d5ec7821-0020-4357-902a-1b43a8278fc8"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:06.383496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.384217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.384815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.398081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] Creating event network-changed:d5ec7821-0020-4357-902a-1b43a8278fc8 for instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 on hv-cinder-85331 Sep 12 11:58:06.414936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7b362d10-3b76-4a29-99db-eb6ffc1b7c5d req-eaf3e728-c817-496f-bc55-3f934aa2b5b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068228 Sep 12 11:58:06.415550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 357/711] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:06.473371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:06.474061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:06.480832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.481309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.481740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.482430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.483484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.484113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.529154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 11:58:06.530200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 11:58:06.530819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 11:58:06.531234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 11:58:06.531669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 11:58:06.540563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.541050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.541486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.542211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.542701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.543127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.560427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Getting quotas for project ad01763b3d76492598530234d3b75ec8. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 11:58:06.565131 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Getting quotas for user f4b71a4e5c1a4656a541f9cacec0af18 and project ad01763b3d76492598530234d3b75ec8. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 11:58:06.576040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 11:58:06.579029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 11:58:06.617281 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.625470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b69575b5-1fc7-421a-8379-b7bc1562ec01 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876891 Sep 12 11:58:06.626301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 355/712] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 11:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 11:58:06.627565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c854088e-cad2-467e-b218-13a97436930d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.158388 Sep 12 11:58:06.628483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 358/713] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:06 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:06.636801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9691d457-2510-4c14-81ad-87ab02ed6ab2 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:06.637404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9691d457-2510-4c14-81ad-87ab02ed6ab2 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:06.696159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9691d457-2510-4c14-81ad-87ab02ed6ab2 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.704337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9691d457-2510-4c14-81ad-87ab02ed6ab2 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1219 microversion: 2.1 time: 0.071137 Sep 12 11:58:06.707326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 356/714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:06 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:06.746677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:06.747670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:06.755252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.755922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.756516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.757380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:06.758098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:06.758891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:06.916217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:06.924174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-73d8e906-c3e8-43be-98a7-c0e002b64cab tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.181403 Sep 12 11:58:06.924776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 359/715] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:06 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:07.374562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:07.375619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:07.389829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.393534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.395888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.396946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.401470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.401931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.437537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b230ba8-8256-43a9-ba1d-bd1167fd36bf", "name": "network-vif-plugged", "status": "completed", "tag": "9cab3842-6521-4349-b9ee-73997786a3bf"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:07.452392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.456938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.457572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.483552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] Creating event network-vif-plugged:9cab3842-6521-4349-b9ee-73997786a3bf for instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf on hv-cinder-85331 Sep 12 11:58:07.510663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-925b427a-fae6-4fd1-8655-e3b7f396d384 req-8db56cec-73ac-4d56-a157-7356fc50cc50 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076566 Sep 12 11:58:07.511470 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 360/716] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:07.651508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:07.652241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:07.659869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.660537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.661153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.662022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.662668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.663270 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.786905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:07.794852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:07.796424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:07.797577 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fa09f1e-5a83-475a-83b7-076bf31e1177 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.428354 Sep 12 11:58:07.798137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 357/717] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:07 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:07.813953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:07.816388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:07.817000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:07.821799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-85669665-0807-4974-938c-1037250d141a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.174822 Sep 12 11:58:07.822369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 361/718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:07 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:07.823019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.823587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.824031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.824723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.825175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.825602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.885920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:07.893577 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99b68c93-81a8-463f-be87-53dbbdcb4670 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1271 microversion: 2.1 time: 0.081105 Sep 12 11:58:07.894136 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 358/719] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:07 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:07.950697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:07.951415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:07.958071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.958587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.959030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:07.959726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:07.960180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:07.960756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.087374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:08.095732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-553c8633-090e-4ef0-a092-b94ad49546a0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.150697 Sep 12 11:58:08.096297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 362/720] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:07 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:08.825840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:08.826476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:08.832818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.833298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.833727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.834402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.834880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.835301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.844308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:08.844926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:08.851329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.851809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.852245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.852961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.853412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.853835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.965512 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:08.973521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:08.975025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:08.976161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43c1c414-75e6-4342-b008-c385e0f0a141 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.154196 Sep 12 11:58:08.976717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 359/721] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:08 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:08.981140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:08.981735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:08.988027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.988511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.988945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.989633 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:08.990080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:08.990501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:08.991978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:08.999803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4bf0aa79-950d-4333-9188-0616ba0903d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.159278 Sep 12 11:58:09.000371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 363/722] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:08 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:09.054550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:09.062130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1d29563-f894-45ec-a0fa-4d3041cbae04 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1271 microversion: 2.1 time: 0.084487 Sep 12 11:58:09.062717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 360/723] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:08 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:09.118285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:09.118930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:09.124853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:09.125333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:09.125803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:09.126483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:09.126960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:09.127411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:09.255602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:09.263104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0f9d19b-ca5d-4ee7-b382-777013541947 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.148699 Sep 12 11:58:09.263667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 364/724] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:09 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:10.022461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:10.023116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:10.029897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.030405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.030868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.031578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.032032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.032451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.107432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:10.108764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:10.110728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:10.116041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.116719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.117935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.118186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.118670 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.119091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.167872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.176456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ee2808f0-e10c-4072-9bcc-9a5ab4bb9bc9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.157801 Sep 12 11:58:10.177029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 365/725] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:10 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:10.181599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:10.182396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:10.187895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.188630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.189067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.189757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.190216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.190667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.250052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.251295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.258173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.258678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-948b8f53-6e1b-4ee2-8d4b-ad0d27548c53 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1271 microversion: 2.1 time: 0.080672 Sep 12 11:58:10.259249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 366/726] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:10 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:10.259560 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.260697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afbdb220-0e96-4763-971a-ec3d8643e179 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.263434 Sep 12 11:58:10.261244 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 361/727] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:09 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:10.286026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:10.286669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:10.292534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.293016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.293454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.294143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:10.294631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:10.295732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:10.420131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:10.427679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-43913826-eb91-4764-bfb6-a6b4516d1967 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.145293 Sep 12 11:58:10.428251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 367/728] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:10 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:11.200598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:11.201231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:11.209625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.210232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.210808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.211609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.212175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.212688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.282359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:11.282903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:11.290207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.290715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.291146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.291824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.292514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.293029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.351953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.360017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.361194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a9e0bb9-156a-4918-8f73-c760922dee2f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.164375 Sep 12 11:58:11.361763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 362/729] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:11 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:11.364908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:11.367749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:11.368685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:11.371844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-54d3a8e3-3142-4da2-bd3c-eb60fd9b886c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1271 microversion: 2.1 time: 0.093541 Sep 12 11:58:11.376455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.377126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.377737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.378634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.379087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.379507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.387004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 368/730] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:11 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:11.453112 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:11.453821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:11.461099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.461669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.462201 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.463335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.470703 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.472608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.579197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.592737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.594738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.596509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e590bbad-2257-4c2c-8da5-af17d5f356f8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.233390 Sep 12 11:58:11.597451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 363/731] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:11 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:11.602562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "name": "network-vif-unplugged", "status": "completed", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:11.613402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:11.614205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:11.614774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:11.629740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] Creating event network-vif-unplugged:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:58:11.637584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4777080e-d6fe-46b8-a1db-c4a7c47c0402 req-46c4586a-35f6-49c2-b477-58f164105df6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038643 Sep 12 11:58:11.640767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 364/732] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:11.682238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:11.691019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c90f6390-0f47-4622-9dc2-83f280cdd29c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.243794 Sep 12 11:58:11.691600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 369/733] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:11 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:12.387777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:12.388385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:12.394734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.395227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.395533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:12.395970 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.396147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:12.396591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.397381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.398129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.403690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.404737 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.405370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.406382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.407056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.407749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.470890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.478464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f390da7a-37bc-4291-aee5-40ee995260b5 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1271 microversion: 2.1 time: 0.086711 Sep 12 11:58:12.479427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 370/734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:12 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:12.540505 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.549132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4650bc2b-346f-4e15-8766-b69dbb14abd1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1367 microversion: 2.1 time: 0.167189 Sep 12 11:58:12.549699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 365/735] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:12 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:12.625295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:12.625900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:12.631823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.632297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.632727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.633399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.633848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.634265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.715231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:12.715842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:12.722503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.723031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.723469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.724167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:12.724621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:12.725046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:12.800415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.808946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.812185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.812185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b114b538-6531-4d5f-bcfc-5b942d50000b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.190407 Sep 12 11:58:12.812902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 371/736] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:12 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:12.945591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:12.957374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8685c192-5183-4285-8b74-02f5097d2711 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.246742 Sep 12 11:58:12.958278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 366/737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:12 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:13.501637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:13.502251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:13.508728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.509200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.509628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.510302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.510785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.511205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.572640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:13.573073 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:13.573944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:13.579673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.580167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.580604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.581302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.581499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e9f5588d-2773-454d-937a-81900c6368e7 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1279 microversion: 2.1 time: 0.084381 Sep 12 11:58:13.581759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.582196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.582343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 372/738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:13 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:13.708019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:13.715581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee7e5104-cb97-4eee-bdd3-004d06cf9215 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1557 microversion: 2.1 time: 0.147014 Sep 12 11:58:13.716157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 367/739] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:13 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:13.739045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:13.739539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:13.745371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.745856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.746297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.747008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.747466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.747927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.828373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b1e14c38-cde8-49e1-a364-327afd32993c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093115 Sep 12 11:58:13.829051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 373/740] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 11:58:13 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:13.837388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:13.838010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:13.844617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.845111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.845656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.846239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.847090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.847373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.895133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e94a234-87f5-4731-aca7-9d97d53b48e1", "name": "network-vif-plugged", "status": "completed", "tag": "d5ec7821-0020-4357-902a-1b43a8278fc8"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:13.905494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.906167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.906469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.919366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] Creating event network-vif-plugged:d5ec7821-0020-4357-902a-1b43a8278fc8 for instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 on hv-cinder-85331 Sep 12 11:58:13.926363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a70c03b2-033e-4c1b-95a3-3e73a2ad2b90 req-23ef705c-f5b1-452a-bd06-78d463f1d010 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034794 Sep 12 11:58:13.927318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 374/741] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:13.984404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:13.985116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:13.992066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.992559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.992996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:13.993695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:13.994153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:13.994604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:14.112662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:14.124046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:14.125492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:14.126683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b204842d-add5-4e0b-8446-2a6b5e0182af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.293386 Sep 12 11:58:14.127236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 368/742] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:13 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:14.141857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:14.153748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f93d4d4a-9885-4974-b366-eec84d1830d0 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.174910 Sep 12 11:58:14.154484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 375/743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:13 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:14.604649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:14.605266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:14.612229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:14.612713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:14.613146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:14.613831 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:14.614283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:14.614734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:14.685829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:14.693539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1068498-9fb2-467f-925c-bb5fe2937f94 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1279 microversion: 2.1 time: 0.092755 Sep 12 11:58:14.694108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 369/744] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:14 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:14.862288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b230ba8-8256-43a9-ba1d-bd1167fd36bf", "tag": "9cab3842-6521-4349-b9ee-73997786a3bf"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:14.871908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:14.872377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:14.872806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:14.883673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] Creating event network-changed:9cab3842-6521-4349-b9ee-73997786a3bf for instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf on hv-cinder-85331 Sep 12 11:58:14.888991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-2bbc0ca9-55af-4bdb-965b-c6e61002a562 req-a09b4b04-9402-4699-9aa5-57eda976bcdc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029879 Sep 12 11:58:14.889588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 376/745] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:15.157335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:15.158090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:15.163989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.164475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.164913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.165602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.166063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.166493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.176792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:15.177488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:15.184043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.184535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.184974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.187187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.187656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.188359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.309451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:15.319825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:15.321624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:15.323055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9ae4b34-08d7-48a2-a928-05de833ec153 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1719 microversion: 2.20 time: 0.170202 Sep 12 11:58:15.324021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 370/746] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:15 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:15.348243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:15.358834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6beb35da-0c53-4c6a-bc17-94e70bed0cd7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.185937 Sep 12 11:58:15.359411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 377/747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:15 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:15.716385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:15.717904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:15.730884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.733677 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.734209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.735440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:15.739610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:15.741966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:15.792281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:15.893853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:15.906895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b577cb3d-96b0-4387-a321-4b05ded9d4b0 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1277 microversion: 2.1 time: 0.190987 Sep 12 11:58:15.910928 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 371/748] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:15 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:16.349234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:16.349963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:16.356726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.357384 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.357855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.358600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.359057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.359482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.385883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:16.386628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:16.393569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.394176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.394904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.395872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.396413 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.396909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.500919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:16.509444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:16.510925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:16.512144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dd156b2d-3764-4db1-8602-28afe626ab93 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1722 microversion: 2.20 time: 0.166959 Sep 12 11:58:16.512711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 378/749] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:16 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:16.537488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc622d56-8797-4215-ab32-dc363d27ac38"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:16.540391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:16.547358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.547844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.548282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.548982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.549466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.549893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.551803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:16.701173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:16.715311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:16.724838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1afca993-84f3-4ca1-90c6-13ceab0e1781 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.342904 Sep 12 11:58:16.726357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 372/750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:16 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:16.859002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-887f4d94-39fe-4445-9287-48913c3890d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325401 Sep 12 11:58:16.859579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 379/751] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Sep 12 11:58:16 2022] POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 11:58:16.931018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:16.931644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:16.938495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.939025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.939780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:16.940502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:16.940966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:16.941460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.006701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:17.007299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:17.015398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.015884 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.016314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.019187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.019796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.019921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:17.020119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.028718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-895186bb-037e-4069-852e-40f5c872e882 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1277 microversion: 2.1 time: 0.102636 Sep 12 11:58:17.029824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 373/752] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:16 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:17.072590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120424) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 11:58:17.152002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90d74eaf-1f1d-48b0-9ef4-2fdf31c7bd2a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/action" status: 202 len: 0 microversion: 2.20 time: 0.150960 Sep 12 11:58:17.152872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 380/753] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 12 11:58:16 2022] POST /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 12 11:58:17.162972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:17.163587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:17.172498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.172987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.173426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.174123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.174619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.175045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.314373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:17.323423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:17.324885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:17.326791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c9ff9a1-cbcb-44cf-9e67-11ee69b0786a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1808 microversion: 2.20 time: 0.168678 Sep 12 11:58:17.327350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 374/754] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:17 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:17.748986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:17.749780 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:17.753591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:17.757245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.757974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.758684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.759618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:17.760288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:17.760936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:17.905902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:17.914501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c18a7429-ed2b-4e58-b1dc-143a80e3c9e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1314 microversion: 2.1 time: 0.169399 Sep 12 11:58:17.915232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 381/755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:17 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:18.053615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:18.055118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:18.063524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.064296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.065124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.066045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.066719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.067463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.320466 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:18.330177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcc4b185-6aea-461e-9003-697d046076ac tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.280514 Sep 12 11:58:18.330868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 375/756] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:18 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:18.352821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:18.353806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:18.361415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.362401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.363412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.364340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.365016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.365657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.510854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:18.520069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:18.521494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:18.522670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1952d578-476d-4179-83c5-0f832f6c3bca tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1808 microversion: 2.20 time: 0.174608 Sep 12 11:58:18.523232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 382/757] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:18 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:18.622629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e247c23-36ae-485e-a832-199eb23191d4", "tag": "756372de-6577-41d2-8e60-ade0a05e5082"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:18.632748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.633219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.633641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.644243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] Creating event network-changed:756372de-6577-41d2-8e60-ade0a05e5082 for instance 5e247c23-36ae-485e-a832-199eb23191d4 on hv-cinder-85331 Sep 12 11:58:18.649121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b2b4cfd3-da7c-492d-af8a-4c1eb4b97337 req-fc1bf7ac-c98a-408a-a50e-850640ea9b51 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030164 Sep 12 11:58:18.649702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 376/758] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:18.937832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:18.938716 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:18.945078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.945564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.945998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.946717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:18.947171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:18.947590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:18.965448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:19.082091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.090438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d3e9abbd-b16c-4516-a813-c05c70ae87ac tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1464 microversion: 2.1 time: 0.157099 Sep 12 11:58:19.091056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 383/759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:18 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:19.138050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:19.138649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:19.145875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.146366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.146833 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.147536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.147998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.148426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.176902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:58:19.273364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50adc892-80e7-413c-a966-c96b6a4bc7ed tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 204 len: 0 microversion: 2.1 time: 0.138980 Sep 12 11:58:19.274272 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 377/760] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:58:19 2022] DELETE /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:58:19.283503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:19.284257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:19.290751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.291303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.291802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.292660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.293176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.293691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.353431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:19.354225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:19.360224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.360685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.361118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.361807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.362258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.362711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.428261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.435785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-025a78fb-c0c7-4056-b662-4fe27697e675 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1470 microversion: 2.1 time: 0.157074 Sep 12 11:58:19.436631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 384/761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:19 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:19.496272 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.503958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd46cc25-9943-4477-a660-5ce943e40975 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.154813 Sep 12 11:58:19.504516 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 378/762] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:19 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:19.548246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:19.548767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:19.554864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.555335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.555763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.556439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:19.556883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:19.557300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:19.688368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.696794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.698214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:19.699393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de5e88b0-db24-4a60-a874-b3939cce14fb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1750 microversion: 2.20 time: 0.155550 Sep 12 11:58:19.699937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 385/763] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:19 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:20.458875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:20.459435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:20.465662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.466140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.466596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:20.467367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.467823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.468264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:20.527206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:20.527815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:20.534197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.534708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.535147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:20.535839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.536290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.536713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:20.600502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:20.608848 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dac9cb6-dea6-4bcb-89e1-d85381d8d74d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1470 microversion: 2.1 time: 0.153597 Sep 12 11:58:20.609565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 379/764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:20 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:20.681388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:20.690796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-69786f4c-fa9c-486b-9f5d-72d17f5858ce tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.167339 Sep 12 11:58:20.691394 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 386/765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:20 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:20.726341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:20.726888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:20.733204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.733681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.734169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:20.735000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:20.735511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:20.736026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:21.069445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:21.078350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:21.079827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:21.081039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02869bd1-2c49-4f3d-9f73-5dca270d0e8a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1750 microversion: 2.20 time: 0.358653 Sep 12 11:58:21.081713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 380/766] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:20 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1750 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:21.631690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:21.632297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:21.638769 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:21.639503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:21.640124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:21.640897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:21.641499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:21.642075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:21.716271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:21.716791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:21.723080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:21.723576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:21.724018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:21.724765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:21.725873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:21.725873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:21.795526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:21.810462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ff89dd4f-9d99-4270-8e43-9799070b4215 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1470 microversion: 2.1 time: 0.182533 Sep 12 11:58:21.811302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 387/767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:21 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:22.074855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:22.085830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1af78b40-2311-4461-ad75-ee2142a4967f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.373497 Sep 12 11:58:22.086587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 381/768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:21 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:22.108613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:22.109255 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:22.116116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:22.116604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:22.117036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:22.117744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:22.118192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:22.118763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:22.261781 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:22.271306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:22.273074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:22.274776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-baa2fd6e-04f9-4125-80e3-a9169a3d6d83 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.170684 Sep 12 11:58:22.275349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 388/769] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:22 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:22.835822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:22.836430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:22.843095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:22.843596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:22.844043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:22.844733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:22.845182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:22.845603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:22.934130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e94a234-87f5-4731-aca7-9d97d53b48e1", "name": "network-vif-deleted", "tag": "d5ec7821-0020-4357-902a-1b43a8278fc8"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:22.940293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:22.948501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:22.949796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:22.950230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b96ebe2-7d31-4d18-8912-4a69b5be7901 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1428 microversion: 2.1 time: 0.118164 Sep 12 11:58:22.950459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:22.950967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 382/770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:22 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:22.968846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] Creating event network-vif-deleted:d5ec7821-0020-4357-902a-1b43a8278fc8 for instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 on hv-cinder-85331 Sep 12 11:58:22.976094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-77186da3-6ad6-4bff-b096-91b3e5219dbe req-4bd05931-d209-45ff-a417-c95bc3b0a6b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045609 Sep 12 11:58:22.976874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 389/771] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:58:23.111853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:23.112286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:23.119816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.119816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.120416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:23.121209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.121796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.122089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:23.272125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:23.279745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1effaee-89f9-4e0f-8cd4-cdb9509911a6 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.173142 Sep 12 11:58:23.280309 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 383/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:23 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:23.301109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:23.301790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:23.307862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.308342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.308772 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:23.309445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.309891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.310307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:23.451040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:23.459654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:23.461084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:23.462232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-addabc28-8459-4ae4-b0dc-e6a0b0197fd0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.165955 Sep 12 11:58:23.462842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 390/773] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:23 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:23.976084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:23.976685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:23.983422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.983841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.984369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:23.985042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:23.985487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:23.985910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:24.050253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:24.057863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bce37560-3d59-409d-8114-18f4255fe0bb tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1299 microversion: 2.1 time: 0.085620 Sep 12 11:58:24.058427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 384/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:23 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:24.304904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:24.305444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:24.312031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:24.313256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:24.313694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:24.314372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:24.314856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:24.315277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:24.445505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:24.453680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3cb750ca-7ad8-447e-b1b7-ee35e3f21714 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.152086 Sep 12 11:58:24.454252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 391/775] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:24 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:24.488470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:24.489082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:24.494903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:24.495384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:24.495825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:24.496510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:24.496969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:24.497399 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:24.623481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:24.632536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:24.633959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:24.635142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80096399-3c05-4055-9b02-358893ed17d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.151017 Sep 12 11:58:24.635697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 385/776] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:24 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:25.081200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:25.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:25.087740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.088220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.088656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.089337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.089791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.090209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.151511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:25.159724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ffff716c-a902-4316-ac84-12f4ad2c4754 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1299 microversion: 2.1 time: 0.082601 Sep 12 11:58:25.160310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 392/777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:25 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:25.476134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:25.476747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:25.483166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.483650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.484105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.484859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.485312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.485739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.613029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:25.620597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-418757c6-628b-4c69-996d-fe2478976098 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.148327 Sep 12 11:58:25.621154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 386/778] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:25 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:25.660262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:25.660874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:25.666984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.667465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.667904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.668586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:25.669046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:25.669503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:25.803393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:25.811971 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:25.814689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:25.815860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-36e5a4d0-f0f1-4f24-9163-162897be1339 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.159658 Sep 12 11:58:25.816428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 393/779] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:25 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:26.183041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:26.183644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:26.190258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.190760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.191194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.191866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.192330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.192741 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.196740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:26.257966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:26.265672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13b9636b-2b51-4f9d-88d3-16edc6c1a073 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1299 microversion: 2.1 time: 0.086416 Sep 12 11:58:26.266202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 387/780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:26 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:26.643763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:26.644393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:26.650631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.651116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.651549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.652229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.652681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.653105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.791380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:26.799455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8aa15eb2-20e2-4cfc-91d5-b27e39579ae8 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.159619 Sep 12 11:58:26.800018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 394/781] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:26 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:26.841916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:26.842419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:26.849733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.850220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.850704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.851390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:26.851844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:26.852270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:26.994098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:27.002844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:27.004268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:27.005423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2816b93d-1e85-4fa9-a868-b4d84be478d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.167749 Sep 12 11:58:27.005980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 388/782] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:26 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:27.288660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:27.289183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:27.295947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:27.296432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:27.296985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:27.297675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:27.298129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:27.298579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:27.365048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:27.378379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c689642-9cb0-4327-8534-054c5bb2dcf2 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1299 microversion: 2.1 time: 0.093681 Sep 12 11:58:27.378994 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 395/783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:27 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:27.821750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:27.822278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:27.828998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:27.829573 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:27.829926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:27.830650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:27.831122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:27.831559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.029937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:28.031587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:28.032189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:28.037789 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-211328f5-1b5c-4a7f-94d3-a4c191030ecf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.219890 Sep 12 11:58:28.038402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 389/784] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:27 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:28.038544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.038937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.039393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.040081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.040529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.040961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.183486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:28.193054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:28.194475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:28.195678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abe283e9-27cd-48f9-b22f-0f2e30dac325 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.167965 Sep 12 11:58:28.196239 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 396/785] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:28 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:28.408370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:28.409184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:28.415360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.417037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.418001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.419403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.420079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.421184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.468447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.468939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.469376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.469819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:28.521439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:28.523893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e247c23-36ae-485e-a832-199eb23191d4", "name": "network-vif-plugged", "status": "completed", "tag": "756372de-6577-41d2-8e60-ade0a05e5082"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:28.533668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d86906ec-6886-4515-ae7e-50b667d63f1b tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.130324 Sep 12 11:58:28.534559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 390/786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:28 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:28.556172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:28.556936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:28.557126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:28.570001 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] Creating event network-vif-plugged:756372de-6577-41d2-8e60-ade0a05e5082 for instance 5e247c23-36ae-485e-a832-199eb23191d4 on hv-cinder-85331 Sep 12 11:58:28.575176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7823ef8e-eefc-445c-953c-a9d49de47b9e req-80c0d2c1-aff7-481f-8c8d-40ac3c1114e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054757 Sep 12 11:58:28.575812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 397/787] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:58:29.065383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:29.066834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:29.074147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.074670 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.075304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.076002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.076459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.076948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.221623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:29.221962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:29.222682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:29.229236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.229403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95f6b9ea-d7b5-4a96-a63e-72fb482b3b41 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.169293 Sep 12 11:58:29.229711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.229979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 391/788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:29 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:29.230132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.230839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.231283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.231701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.361709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:29.370286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:29.371712 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:29.372847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3090f86b-62da-4f54-a7a6-73b24760e950 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.155392 Sep 12 11:58:29.373408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 398/789] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:29 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:29.558037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:29.558676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:29.564957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.565445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.565893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.566609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.567070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.567502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.597135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:29.597628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:29.598067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:29.598527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:29.641482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:29.649104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-370d5cf1-928d-46fb-82d7-3eaecb5273e7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.095307 Sep 12 11:58:29.649675 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 392/790] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:29 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:30.253709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:30.254315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:30.260700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.261170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.261599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.262271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.262803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.263219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.398422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:30.399012 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:30.402603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:30.406435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.407227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.407667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.408388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.409026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.409451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.410591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e0affac-078e-4138-a533-fe394f983ad4 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.161377 Sep 12 11:58:30.411175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 399/791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:30 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:30.554075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:30.563747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:30.565192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:30.566353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3af6735-b232-47cb-82ca-f109296860ba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.171995 Sep 12 11:58:30.566950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 393/792] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:30 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:30.673045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:30.673583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:30.679554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.680038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.680477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.681163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.681618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.682045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.714039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:30.714581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:30.715197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:30.715824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:30.760176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:30.768234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0855ef46-9c7a-482d-a06f-895a2b27e43c tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.100055 Sep 12 11:58:30.769162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 400/793] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:30 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:31.433659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:31.434273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:31.441459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.441953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.442387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.443108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.443558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.443983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.581239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:31.588674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10cf060c-d5e2-481f-a24a-911a87b9faa9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.158864 Sep 12 11:58:31.589230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 394/794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:31 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:31.593610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:31.594552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:31.600938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.601427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.601863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.602578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.603045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.603474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.607464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:31.748418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:31.758201 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:31.759668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:31.760820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-263fee79-ac46-465e-8d93-872a132cf3cb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.171735 Sep 12 11:58:31.761380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 401/795] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:31 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:31.792888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:31.793594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:31.799766 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.800248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.800684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.801381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.801837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.802262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.836176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:31.836678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:31.837122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:31.837575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:31.881212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:31.888891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bb4fc29-9662-4487-8bdd-43fb9d510ccf tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.100085 Sep 12 11:58:31.889452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 395/796] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:31 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:32.613873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:32.614483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:32.620579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.621057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.621488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.622176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.622650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.623067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.768063 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:32.775929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-26c0ffc5-2a2a-44a1-920c-cb02cbb80a33 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.167746 Sep 12 11:58:32.776501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 402/797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:32 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:32.788400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:32.789010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:32.795566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.796044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.797080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.797774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.798231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.798714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.912810 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:32.913447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:32.919792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.920266 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.920690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.921513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.921966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.922385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.938575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:32.947239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:32.948661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:32.949808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe08ced4-17f6-4c94-b175-a649177908c0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.165596 Sep 12 11:58:32.950622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 396/798] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:32 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:32.953017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:32.953530 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:32.953953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:32.954393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:33.001719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:33.009638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-14778aa6-a388-43ea-81c4-682665546cb7 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.100680 Sep 12 11:58:33.010220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 403/799] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:32 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:33.799768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:33.800381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:33.806752 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:33.807234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:33.807669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:33.808357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:33.808814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:33.809242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:33.944683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:33.952096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02987bb2-27db-4303-8453-30f9caaa91ae tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.156904 Sep 12 11:58:33.952653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 397/800] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:33 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:33.976387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:33.977043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:33.984277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:33.984776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:33.985211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:33.986077 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:33.986638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:33.987066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:34.033270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:34.033886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:34.040002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:34.040482 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:34.040915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:34.041604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:34.042052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:34.042727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:34.073559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:34.073951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:34.074386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:34.074921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:34.121135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:34.136862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b3090c2-468f-4094-95bc-9ad50b34959d tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.108452 Sep 12 11:58:34.138233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 398/801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:34 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:34.140100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:34.151043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:34.152564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:34.153732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f9e26a84-fdab-4b4e-be66-d45d4bfd6e35 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.181258 Sep 12 11:58:34.154287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 404/802] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:34.974674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:34.975579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:34.981735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:34.982467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:34.982935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:34.984165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:34.984621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:34.985046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.125525 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:35.133298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f713f5da-fac3-4378-9e14-276d9c384b2f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.162580 Sep 12 11:58:35.133859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 399/803] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:34 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:35.160789 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:35.161392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:35.167963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:35.168445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:35.168877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.169570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:35.170017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:35.170435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.180397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:35.180998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:35.188304 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:35.188792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:35.189248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.189926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:35.190376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:35.190871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.209279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:35.209777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:35.210241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:35.210760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:35.256317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:35.265948 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-211bc129-18a2-4778-8822-495bc5d22fee tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.108421 Sep 12 11:58:35.266700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 405/804] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:35 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:35.329679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:35.338179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:35.339636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:35.340780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7420ad6-d297-4852-b6d4-03e26de5394f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.164249 Sep 12 11:58:35.341338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 400/805] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:35 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:36.156946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:36.157971 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:36.164622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.165424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.165520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.166343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.166885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.167545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.289121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:36.289776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:36.296572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.297406 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.298076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.298803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.299295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.299727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.300262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:36.307995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bab826d8-59c8-4715-af41-0b748433a12a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.155027 Sep 12 11:58:36.308651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 406/806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:36 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:36.332718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.333201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.333648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.334110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:36.367620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:36.368571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:36.380163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.380813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.381393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.382312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:36.382803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:36.383291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:36.391551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:36.399151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c68820a-93c3-4826-b474-9ffb1743a427 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.114080 Sep 12 11:58:36.399710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 401/807] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:36 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:36.513433 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:36.522707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:36.524172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:36.525335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-316597b5-e731-40b2-a0ad-311f27d9ad13 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.162126 Sep 12 11:58:36.526104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 407/808] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:36 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:37.331679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:37.332279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:37.338760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.339246 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.339686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.340369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.340825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.341251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.345717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:37.424005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:37.424916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:37.432356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.432840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.433273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.433966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.434472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.434956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.467066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.467549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.467982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.469018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:37.490462 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:37.498560 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b4565d6-77d8-4398-b2a1-730e7e193543 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.171416 Sep 12 11:58:37.499357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 402/809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:37 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:37.519725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:37.527948 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-37467f39-1f0f-46c9-a205-7151883450cc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.110356 Sep 12 11:58:37.543886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 408/810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:37 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:37.552957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:37.553586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:37.555475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:37.560652 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.561158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.561588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.563138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:37.563611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:37.564028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:37.703714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:37.712711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:37.714148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:37.715345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50037a3b-9ce8-4e7c-ad25-84041f31bf7b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.166590 Sep 12 11:58:37.716278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 403/811] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:37 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:38.524267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:38.524888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:38.531881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.532362 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.532795 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.533476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.533930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.534381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.565367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:38.566077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:38.574233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.574912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.575417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.576434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.576955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.577605 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.623489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.624067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.624613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.625168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:38.668669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:38.669756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:38.677115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-955307ca-219f-4512-b8c7-1829fa8e9018 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.115784 Sep 12 11:58:38.677682 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 404/812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:38 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:38.678024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-48e7f8c0-b3f6-448c-9b82-3e2f4a2eaf17 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.157663 Sep 12 11:58:38.678604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 409/813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:38 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:38.743892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:38.744481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:38.750876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.751329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.751757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.752440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:38.752886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:38.753306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:38.886602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:38.895612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:38.897655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:38.898949 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16b993a1-f963-444d-b31d-789af18c02b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.159060 Sep 12 11:58:38.899694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 405/814] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:38 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:39.708225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:39.708874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:39.709814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:39.710454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:39.716802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.717281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.717704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.717822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.718231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.718419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.718764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.719053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.719444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.719641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.719896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.720319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.752367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.752859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.753321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.753771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:39.795111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:39.809118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1f85751e-d6c3-4cf0-8000-17c26f405afe tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.107354 Sep 12 11:58:39.809118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 410/815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:39 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:39.853265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:39.861438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4738fd6-8b8b-49ab-a1f9-a0e3dbf13e1f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.163673 Sep 12 11:58:39.861996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 406/816] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:39 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:39.925002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:39.925676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:39.931676 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.932170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.932609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:39.933289 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:39.933745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:39.934169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.070293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:40.080440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:40.081345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:40.082583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e00be04e-b715-42a8-b7ea-e5a2ab501f34 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161723 Sep 12 11:58:40.083336 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 411/817] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:39 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:40.840155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:40.841151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:40.850043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:40.850668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:40.853111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.853111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:40.853111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:40.853111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.884768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:40.885356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:40.886022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:40.886554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:40.887009 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.887458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:40.892160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:40.892632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:40.893059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.893743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:40.894317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:40.894760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:40.931212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:40.939684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96830115-c2f1-45d2-b24c-0938a28c382f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.112917 Sep 12 11:58:40.940262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 407/818] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:40 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:41.031180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:41.039291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-34f7ff2c-eb4a-4581-b59c-cb410d8fef3c tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.158647 Sep 12 11:58:41.039852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 412/819] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:40 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:41.109689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:41.110535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:41.117214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:41.117423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:41.118060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:41.118878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:41.119358 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:41.119860 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:41.290497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:41.299989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:41.301431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:41.302617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c877746-bc99-4fc2-9e81-3d55b2e1210c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.198185 Sep 12 11:58:41.303191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 408/820] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:41 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:41.963329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:41.963938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:41.971261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:41.971739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:41.972167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:41.972839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:41.973291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:41.973705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.007960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:42.008437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:42.008865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.009304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:42.051017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:42.058524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f57a181d-6451-49ea-8ace-21979314c48a tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.099230 Sep 12 11:58:42.059088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 413/821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:41 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:42.062641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:42.063437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:42.069377 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:42.069857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:42.070295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.071008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:42.071463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:42.071892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.209152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:42.216851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-508a3775-1086-4a15-8259-6454ec7c0ade tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.158275 Sep 12 11:58:42.217344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 409/822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:42 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:42.332796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:42.333395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:42.339342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:42.339822 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:42.340258 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.340965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:42.341419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:42.341838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:42.478082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:42.487610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:42.489074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:42.490286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-711aedf0-5384-4998-bc74-7bbcf1f1e0c4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161460 Sep 12 11:58:42.490888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 414/823] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:42 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:43.081536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:43.082881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:43.090202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.090978 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.091448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.092153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.092607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.093570 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.127666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.128155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.128594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.129036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:43.172195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:43.179831 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4096b17c-98a4-4630-8e83-bad904542ad1 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.102232 Sep 12 11:58:43.180395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 410/824] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:43 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:43.239550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:43.240271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:43.246743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.247222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.247652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.248330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.248777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.249227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.386090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:43.394048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2a29a80e-ff47-4610-ae48-541bf05036d9 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.158347 Sep 12 11:58:43.394631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 415/825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:43 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:43.518274 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:43.518905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:43.524783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.525264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.525700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.526378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:43.526858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:43.527285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:43.663041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:43.672022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:43.673467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:43.674804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c95ff5db-5973-4312-a2d8-0fdcbc6adcb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161256 Sep 12 11:58:43.675367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 411/826] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:43 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:44.063564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:44.063955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:44.069830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.070304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.070767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.071775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.072243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.072664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.076642 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:44.097346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9dea5a38-b781-447a-aeb1-56f01f37cea0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/ips" status: 200 len: 146 microversion: 2.1 time: 0.038683 Sep 12 11:58:44.097916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 416/827] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 11:58:44 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:44.202812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:44.203415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:44.209859 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.210344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.210812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.211502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.211960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.212388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.242557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.243038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.243565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.244185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:44.285977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:44.294540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c54f9593-9673-4301-9e45-72c7ad526f18 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.095512 Sep 12 11:58:44.295125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 412/828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:44 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:44.417483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:44.418775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:44.426640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.427187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.427625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.428322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.428775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.429196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.567385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:44.575024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-85374bf6-3e8e-455f-99dd-6f6a84433068 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.161788 Sep 12 11:58:44.575583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 417/829] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:44 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:44.702898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:44.703459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:44.709312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.709788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.710220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.710926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:44.711379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:44.711800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:44.848177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:44.856617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:44.858036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:44.859417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1709594f-9725-4a15-b340-2c219ce00766 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161031 Sep 12 11:58:44.860099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 413/830] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:44 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:45.318579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:45.319366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:45.325528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.326006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.326432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.327953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.328487 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.328923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.358667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.359139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.359564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.360000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:45.400860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:45.408428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b8b7e855-c910-445a-9da7-b0bfb76718ad tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.093993 Sep 12 11:58:45.408987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 418/831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:45 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:45.597706 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:45.598319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:45.604678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.605153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.605583 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.606260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.606750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.607168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.735969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:45.743489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a46c6047-3fee-437f-82b1-3e242bb3b28f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.149589 Sep 12 11:58:45.744065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 414/832] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:45 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:45.885288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:45.885850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:45.892488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.892972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.893435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:45.894128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:45.894626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:45.895053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.027040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:46.036032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:46.037464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:46.038634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ce6c1def-fe93-4c28-9609-36fbc2fecfd1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.157299 Sep 12 11:58:46.039195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 419/833] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:45 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:46.430770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:46.431411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:46.438332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:46.438854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:46.439292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.439980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:46.440437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:46.440862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.471187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:46.471667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:46.472103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.472550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:46.515202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:46.522743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e889cf6e-6bb3-4c36-999b-babf648daf3f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.096018 Sep 12 11:58:46.523308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 415/834] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:46 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:46.766450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:46.767085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:46.772954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:46.773413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:46.773840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.774530 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:46.774985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:46.775400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:46.907849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:46.915482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b61ee26e-0968-4670-ae96-407d2362524b tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.152864 Sep 12 11:58:46.915984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 420/835] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:46 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:47.065699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:47.066310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:47.072683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.073163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.073602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.074288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.074768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.075197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.206634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:47.215157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:47.216587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:47.218116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad923fe0-3e15-45a0-8b6a-a3d0ce50eea7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.157046 Sep 12 11:58:47.218707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 416/836] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:47 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:47.545571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:47.546757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:47.553113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.553587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.554104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.554886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.555358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.555791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.585799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.586264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.586729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.587165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:47.628445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:47.635981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12d46b9a-5c4b-4d1a-89a9-f3b7f75c75f3 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.094447 Sep 12 11:58:47.636539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 421/837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:47 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:47.938998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:47.939620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:47.945621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.946106 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.946599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.947294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:47.947755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:47.948186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:47.952826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:48.078899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:48.086490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-430e9c1b-2dcf-4ecd-9ee2-d23d613346c3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.151898 Sep 12 11:58:48.087077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 417/838] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:47 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:48.244097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:48.244626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:48.246925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=97 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:58:48.253270 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.253745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.254176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.254882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.255358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.255775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.384688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:48.393688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:48.395153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:48.396293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-770d2d34-e67c-4e65-aa4d-93271747b279 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.156170 Sep 12 11:58:48.396853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 422/839] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:48 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:48.658619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:48.659229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:48.665414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.665900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.666340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.667063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.667523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.667950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.698372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.698884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.699320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.699761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:48.740544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:48.748005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-714bd4a9-1b6b-4068-9062-dad8452aeb74 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.093245 Sep 12 11:58:48.748558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 418/840] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:48 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:48.819736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2853400-660e-4490-bf67-ba5d9f46420c"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:48.822163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:48.828094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.828570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.828998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:48.829671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:48.830117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:48.830550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.109267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:49.109905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:49.116445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.117103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.117359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.118050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.118506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.118971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.253454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:49.261159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d42bae3b-8e1b-4257-bb38-223119b8f7cf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.156390 Sep 12 11:58:49.261723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 419/841] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:49 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:49.421452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:49.422326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:49.428158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.428655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.429070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.429749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.430198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.430658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.559813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:49.568973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:49.570396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:49.571559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4a81dbd-6104-4b57-8b30-2e2ca8756b3c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.154158 Sep 12 11:58:49.572114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 420/842] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:49 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:49.771183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:49.771776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:49.777703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.778193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.778665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.779357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.779817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.780789 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.811350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:49.812083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:49.812532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:49.812976 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:49.855893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:49.864197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b46e32b-7a68-4dcf-84e6-5353ed617fdc tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.096957 Sep 12 11:58:49.864757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 421/843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:49 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:50.285460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:50.286124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:50.292453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.292928 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.293363 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.294035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.294488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.294935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.423223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:50.430705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-505ea1f2-d15b-4853-be36-a426aaef793d tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.150172 Sep 12 11:58:50.431265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 422/844] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:50 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:50.596489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:50.597089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:50.602869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.603340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.603768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.604439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.604888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.605316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.736543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:50.744972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:50.746402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:50.747567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa0a9cd1-eb1d-4419-a92f-d74b6beca298 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.155318 Sep 12 11:58:50.748118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 423/845] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:50 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:50.886074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:50.886719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:50.892688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.893171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.893614 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.894314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.894792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.895214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.927369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:50.927845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:50.928295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:50.928714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lazy-loading 'fault' on Instance uuid 1e94a234-87f5-4731-aca7-9d97d53b48e1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:58:50.971661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2faaf7fcb0142b6b7aeb68f7e675e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edca5cca3e43e8835b6382e2d5ec1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:50.979161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f17916f4-ecbf-4370-a0ae-3f8373669878 tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 200 len: 1304 microversion: 2.1 time: 0.096932 Sep 12 11:58:50.979718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 424/846] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:50 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:58:51.454470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:51.455176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:51.460934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:51.461410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:51.461837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:51.462527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:51.462979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:51.463396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:51.599707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:51.609282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d58d7a3d-8d84-4aa8-a907-7e694988d54f tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1319 microversion: 2.1 time: 0.158653 Sep 12 11:58:51.614561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 425/847] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:51 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:51.775604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:51.776111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:51.782182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:51.782693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:51.783129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:51.783803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:51.784253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:51.784759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:51.914284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:51.923563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:51.925000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:51.926149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48c6306a-35d5-4a85-a1f3-606e42c786e2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.154573 Sep 12 11:58:51.926735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 426/848] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:51 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:52.001397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:52.001999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] [instance: 1e94a234-87f5-4731-aca7-9d97d53b48e1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:52.008248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.008733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.009172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.009865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.010320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.010776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.023636 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] HTTP exception thrown: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Request method failure captured: Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 HTTP/1.1 Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx68e-0sXSAlUjCgERxvd1YeJHXDUBG2TU16rVUK-PXbzutdiBG7hwOnkC7Dp8if2mcypoEDPpXcoMxvvcadogZDM_-Xbzfm8EFUFUdTa0ybZPb0Hhlmwh95eVZyxDXDMUWoz9a2ZL5wp1cHBs5wE21uEhC77gaSRJHPvRK4GOSLNec Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: e6edca5cca3e43e8835b6382e2d5ec1c Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-1075268828 Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:58:52.025253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e6edca5cca3e43e8835b6382e2d5ec1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e6edca5cca3e43e8835b6382e2d5ec1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e6edca5cca3e43e8835b6382e2d5ec1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e6edca5cca3e43e8835b6382e2d5ec1c"}]}] Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-1075268828 Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: e6edca5cca3e43e8835b6382e2d5ec1c Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-1075268828 Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-1075268828-project Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f2faaf7fcb0142b6b7aeb68f7e675e33 Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-1075268828-project Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. Sep 12 11:58:52.026952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '1e94a234-87f5-4731-aca7-9d97d53b48e1'} Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:58:52.028045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. Sep 12 11:58:52.029703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:58:52.032183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] Returning 404 to user: Instance 1e94a234-87f5-4731-aca7-9d97d53b48e1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:58:52.032183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bdbaf7b2-4f1d-4dac-9e49-e84cb353235f tempest-VolumesNegativeTest-1075268828 tempest-VolumesNegativeTest-1075268828-project] 10.222.0.15 "GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1" status: 404 len: 111 microversion: 2.1 time: 0.028939 Sep 12 11:58:52.032183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 427/849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:51 2022] GET /compute/v2.1/servers/1e94a234-87f5-4731-aca7-9d97d53b48e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 11:58:52.256837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e3706961-7db2-4b88-8bdf-418acf37196c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.440439 Sep 12 11:58:52.257460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 423/850] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:58:48 2022] POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments => generated 194 bytes in 3442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:58:52.632123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:52.632778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:52.638661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.639150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.640198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.640887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.641342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.641769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.775964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:52.785402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26b5980f-902a-4a10-a8ec-3420e13ccddf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1509 microversion: 2.1 time: 0.157061 Sep 12 11:58:52.786147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 428/851] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:58:52 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:58:52.809720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e068041-fde0-4ccb-82bc-4863862041a3", "device": "/dev/sdb"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:58:52.813222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:52.819815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.820312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.820802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.821434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.821887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.822309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.953271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:52.954071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:52.962551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.962845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.963302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:52.964091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:52.967075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:52.967075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:53.137557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e37017e2-09d3-4a58-880c-2fe5bbd9baba tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "POST /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331852 Sep 12 11:58:53.138494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 424/852] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:58:52 2022] POST /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:58:53.153326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:53.169423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:53.175272 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:53.176756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccdceba0-1a74-41d4-8853-cd384c74fc4a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.228514 Sep 12 11:58:53.177429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 429/853] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:52 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 11:58:54.203983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:54.204743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:54.211604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:54.212089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:54.212528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:54.213225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:54.213680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:54.214105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:54.361293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:54.370466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:54.372133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:54.373375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9c30d9b7-1763-47d2-b682-e69e871b3111 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.173767 Sep 12 11:58:54.374246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 425/854] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:54 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:55.399020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:55.399632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:55.406225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:55.406738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:55.407177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:55.407864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:55.408326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:55.408751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:55.540064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:55.549136 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:55.550620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:55.552752 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2c11bc3-bc83-40fe-a699-ea1060724610 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.156615 Sep 12 11:58:55.553316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 430/855] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:55 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:56.579065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:56.579664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:56.586081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:56.586578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:56.587019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:56.587690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:56.588136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:56.588552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:56.720178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:56.728842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:56.730267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:56.731431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b7eacd36-3bb8-4c7c-9f64-b02696f2f005 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.156248 Sep 12 11:58:56.731988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 426/856] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:56 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:57.757510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:57.758035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:57.765839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:57.766328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:57.766790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:57.767553 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:57.768362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:57.769119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:57.917711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:57.928911 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:57.930369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:57.931587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8c81225-c67e-4537-b610-7d668fe763e9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.178731 Sep 12 11:58:57.932159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 431/857] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:57 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:58:58.958916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:58:58.959603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:58:58.966369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:58.966880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:58.968099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:58.968809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:58:58.969262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:58:58.969688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:58:59.104058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:59.112964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:59.114405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:58:59.115589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1645099b-6d69-4ad4-a4ab-78ab23bbe8fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.160926 Sep 12 11:58:59.116151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 427/858] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:58:58 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:00.141566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:00.142168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:00.148714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:00.149193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:00.149625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:00.150306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:00.150777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:00.151202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:00.276834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:00.285862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:00.287312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:00.288443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a7d4003-ce79-4529-91c3-529696338eba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.151123 Sep 12 11:59:00.288992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 432/859] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:00 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:00.891075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:00.897371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:00.897849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:00.898283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:00.958082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Going to try to stop instance {{(pid=120424) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 11:59:00.991002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:01.001739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-488177d8-6b79-4dd2-b036-7a9cd73f7b15 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action" status: 202 len: 0 microversion: 2.1 time: 0.115104 Sep 12 11:59:01.002341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 428/860] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:59:00 2022] POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:59:01.015933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:01.016709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:01.024343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:01.024840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:01.025286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:01.026004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:01.026452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:01.026907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:01.045275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:01.162547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:01.171523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1363c3e1-8186-41f0-80c5-f6810936640f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.159878 Sep 12 11:59:01.172204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 433/861] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:01 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:01.314908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:01.315609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:01.322146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:01.322667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:01.323096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:01.323766 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:01.324213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:01.324629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:01.459254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:01.468340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:01.469668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:01.470837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f24191e9-915d-4d43-a4e7-0756870afa2e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161340 Sep 12 11:59:01.471395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 429/862] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:01 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:02.196030 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:02.196647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:02.203694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:02.204185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:02.204639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:02.205318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:02.205780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:02.206211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:02.337130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:02.345692 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ade447f-8dbb-4545-a0dd-78e5cc59e156 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.153581 Sep 12 11:59:02.346261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 434/863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:02 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:02.497225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:02.497768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:02.504794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:02.505272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:02.505707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:02.506389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:02.506866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:02.507292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:02.638340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:02.648459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:02.649945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:02.651147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2229a8ff-7fa7-4042-8acb-057f80af1cf7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.157883 Sep 12 11:59:02.651714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 430/864] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:02 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:02.926644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "name": "network-vif-plugged", "status": "completed", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:02.936013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:02.936751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:02.937190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:02.947700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] Creating event network-vif-plugged:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 11:59:02.953134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-936c390b-e7f6-47f0-9b8b-6cf8402c852e req-f9c5530f-6cd4-49ba-a5b5-236528c7e6f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219572 Sep 12 11:59:02.953690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 435/865] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:59:03.369072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:03.369686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:03.376644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:03.377129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:03.377568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:03.378255 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:03.378743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:03.379227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:03.507975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:03.516788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-401a9bfe-b128-4ac8-aa64-ae286317cf8f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.151449 Sep 12 11:59:03.517594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 431/866] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:03 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:03.678467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:03.679116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:03.685081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:03.686258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:03.687043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:03.687700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:03.688159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:03.688588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:03.825891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:03.834710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:03.836143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:03.837292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20bc43e9-c7e5-4139-8767-ad46df600bcb tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.163820 Sep 12 11:59:03.837836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 436/867] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:03 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:04.540188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:04.540708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:04.547545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:04.548028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:04.548455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:04.549133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:04.549612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:04.550033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:04.684771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:04.693867 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6c1dfe90-8159-4273-b221-d1208ae56344 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.157577 Sep 12 11:59:04.694426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 432/868] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:04 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:04.862439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:04.863073 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:04.871987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:04.872872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:04.874318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:04.875627 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:04.876460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:04.877199 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:05.008468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:05.017523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:05.019259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:05.020347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84286b5d-b523-409a-b41a-8fca885db994 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.161858 Sep 12 11:59:05.020893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 437/869] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:04 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:05.718074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:05.718712 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:05.725145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:05.725626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:05.726059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:05.726774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:05.727228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:05.727653 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:05.853414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:05.862214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-46d7b707-611b-4476-bb56-a7fef1734df8 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.148677 Sep 12 11:59:05.862803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 433/870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:05 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:06.045731 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:06.046251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:06.052539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:06.053011 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:06.053438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:06.054112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:06.054584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:06.055007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:06.187330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:06.195909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:06.197360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:06.198550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-331b9260-141b-44c5-8dcd-669903c85a0e tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.157259 Sep 12 11:59:06.199088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 438/871] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:06 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:06.886222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:06.886857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:06.893821 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:06.894293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:06.894763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:06.895441 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:06.895893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:06.896318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:07.028654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:07.036786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13773ad0-b4f8-49c0-b0d4-af7f6a9e90aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.154405 Sep 12 11:59:07.037359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 434/872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:06 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:07.223251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:07.223792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:07.230286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:07.230797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:07.231257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:07.231972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:07.233018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:07.233596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:07.365253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:07.374674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:07.376122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:07.377283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0172a296-3b9a-4b01-85c3-c05886b5b5d0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1806 microversion: 2.20 time: 0.157999 Sep 12 11:59:07.377849 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 439/873] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:07 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:08.060152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:08.060783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:08.067457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:08.067933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:08.068364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:08.069044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:08.069693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:08.070118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:08.201748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:08.210720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2ba73ae9-406c-4786-af38-c99f9ad0873d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.154302 Sep 12 11:59:08.211300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 435/874] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:08 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:08.402675 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:08.403279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:08.405797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:08.411054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:08.411532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:08.411962 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:08.412640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:08.413087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:08.413506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:08.546021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:08.555240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:08.556817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:08.558679 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f366abc2-1d2f-45ae-b63a-8276e387dcb1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1793 microversion: 2.20 time: 0.159915 Sep 12 11:59:08.559233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 440/875] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 11:59:08 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1793 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 11:59:09.234911 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:09.235555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:09.241767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:09.242246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:09.242724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:09.243407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:09.243861 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:09.244288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:09.382787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:09.391389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-02c8e505-804d-4281-9eb7-0d993e2125ad tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.160911 Sep 12 11:59:09.391957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 436/876] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:09 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:10.415026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:10.415566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:10.422593 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:10.423079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:10.423517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:10.424204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:10.424663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:10.425090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:10.551831 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:10.559868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f38181c-39b0-4f46-ad2f-1cf09f27c899 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.148699 Sep 12 11:59:10.561388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 441/877] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:10 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:11.583562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:11.584169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:11.590593 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:11.591036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:11.592010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:11.592686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:11.593132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:11.593547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:11.724593 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:11.732848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e4a78b7c-2f8b-4e3d-be04-66f09c6ff9b2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.153131 Sep 12 11:59:11.733413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 437/878] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:11 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:12.761159 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:12.761747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:12.768086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:12.768566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:12.769000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:12.769680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:12.770138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:12.770584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:12.899490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:12.908125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db9962af-8fd3-445d-90b6-78aadc87b2c5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.150940 Sep 12 11:59:12.908676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 442/879] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:12 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:13.932012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:13.932680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:13.940250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:13.940738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:13.941174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:13.941862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:13.942320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:13.942778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:14.073801 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:14.081907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-896690b8-72b1-407e-818d-8391ef732bd0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.153855 Sep 12 11:59:14.082480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 438/880] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:13 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:15.105168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:15.105782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:15.112954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:15.113444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:15.113888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:15.114611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:15.115074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:15.115504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:15.243048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:15.251395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc61daa9-52a9-4784-99b5-bb3798e64bd4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.150110 Sep 12 11:59:15.251957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 443/881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:15 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:16.274880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:16.275501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:16.282567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:16.283054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:16.283491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:16.284182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:16.284640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:16.285069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:16.416084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:16.424738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6241a55-276a-486e-8b6a-12c450e7457f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.153868 Sep 12 11:59:16.425298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 439/882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:16 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:17.448555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:17.449170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:17.455587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:17.456075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:17.456514 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:17.457200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:17.457658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:17.458088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:17.588657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:17.597406 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee22b91c-61c6-4853-8b14-2ec5feaa6ea3 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.152770 Sep 12 11:59:17.597976 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 444/883] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:17 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:18.621419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:18.622684 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:18.625370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=36 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:18.630953 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:18.631428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:18.631859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:18.632538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:18.632984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:18.633403 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:18.763616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:18.772123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af2e4470-d65f-41a1-ad3e-a80a55cae59b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.154536 Sep 12 11:59:18.772687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 440/884] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:18 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:19.794672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:19.795307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:19.802292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:19.802794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:19.803231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:19.803908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:19.804362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:19.804784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:19.940270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:19.948483 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78c7571e-9f75-47af-aa3c-277ddf9d9a32 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.157637 Sep 12 11:59:19.949143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 445/885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:19 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:20.250885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:20.253262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:20.259136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:20.259610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:20.260032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:20.260708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:20.261158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:20.261576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:20.804694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2fda74fe-1c36-42d7-9ee1-fed6dfb811ab tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664270 Sep 12 11:59:20.805294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 441/886] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 11:59:20 2022] POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 11:59:20.972883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:20.973526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:20.980070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:20.980554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:20.980991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:20.982120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:20.982610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:20.983044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:21.116097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:21.124934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89b74b0a-e5fb-458e-a7b5-607d2284109d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.155937 Sep 12 11:59:21.125491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 446/887] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:20 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:22.149508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:22.150240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:22.157197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:22.157728 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:22.158169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:22.158892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:22.159350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:22.159773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:22.304840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:22.314610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9211a726-5102-4b44-9563-361971fe121b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1723 microversion: 2.1 time: 0.169315 Sep 12 11:59:22.315211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 442/888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:22 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:23.338179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:23.338747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:23.346663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:23.347188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:23.347626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:23.348311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:23.348767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:23.349190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:23.484057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:23.492508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cf3e2f0-e56b-4a34-8c0c-d4bfe34d7cb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1700 microversion: 2.1 time: 0.158505 Sep 12 11:59:23.493114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 447/889] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:23 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:23.515300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:23.521712 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:23.522192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:23.522659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:23.545749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Going to try to start instance {{(pid=120424) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 11:59:23.563739 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:23.589225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1d3225ab-a1d9-429e-826c-49934ab70748 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action" status: 202 len: 0 microversion: 2.1 time: 0.077653 Sep 12 11:59:23.589779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 443/890] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:59:23 2022] POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 11:59:23.598606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:23.599220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:23.605228 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:23.605713 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:23.607002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:23.607705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:23.608177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:23.608651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:23.742890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:23.751898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95d807a3-3238-4aea-8e1d-7eb1b0717d66 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1709 microversion: 2.1 time: 0.156905 Sep 12 11:59:23.752468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 448/891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:23 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:24.776670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:24.777310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:24.783494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:24.783981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:24.784419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:24.785138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:24.785595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:24.786024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:24.920313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:24.928469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c7abcc08-cd3e-4fd7-9418-124bdd669b91 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1709 microversion: 2.1 time: 0.156854 Sep 12 11:59:24.929027 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 444/892] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:24 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:25.192160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:25.192639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:25.198944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:25.199423 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:25.200473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:25.201158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:25.201608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:25.202030 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:25.322807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lazy-loading 'services' on Instance uuid 5e247c23-36ae-485e-a832-199eb23191d4 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:59:25.436286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47ce71ad-0ecd-4f6b-b095-132f33dc9bd3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4/os-volume_attachments/0e068041-fde0-4ccb-82bc-4863862041a3" status: 202 len: 0 microversion: 2.1 time: 0.247556 Sep 12 11:59:25.436878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 449/893] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 11:59:25 2022] DELETE /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4/os-volume_attachments/0e068041-fde0-4ccb-82bc-4863862041a3 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:59:25.952460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:25.953062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:25.959357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:25.959831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:25.960268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:25.960932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:25.961379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:25.961805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:26.090934 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:26.098984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-62c29dda-e43f-44bd-ae4a-4ddeddfd68ae tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1709 microversion: 2.1 time: 0.150921 Sep 12 11:59:26.099539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 445/894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:25 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:27.122412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:27.123150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:27.129207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:27.129681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:27.130115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:27.130820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:27.131272 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:27.131695 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:27.135587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:27.268503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:27.276556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f2f3f2d-391e-4406-8164-38b6e19e4c4f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1713 microversion: 2.1 time: 0.159060 Sep 12 11:59:27.277115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 450/895] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:27 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:29.426455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:29.429142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:29.436221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:29.436698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:29.437123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:29.437803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:29.438250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:29.438695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:29.460866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lazy-loading 'flavor' on Instance uuid e4186db1-608b-48ac-9c97-b6f35fa5bbc8 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:59:29.586293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-554a14f5-1b9f-4511-b052-c4d290626f0b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/action" status: 200 len: 32 microversion: 2.1 time: 0.163682 Sep 12 11:59:29.587013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 446/896] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:59:29 2022] POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 11:59:29.597374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:29.598044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:29.604494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:29.604980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:29.605437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:29.607010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:29.607469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:29.607900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:29.773173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:29.782046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41c57c3f-c26f-48d0-a151-1edac50a9f50 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.188515 Sep 12 11:59:29.782643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 451/897] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:29 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:30.799295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:30.799873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:30.805692 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:30.806114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.806300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:30.806409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.806849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.807562 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.808012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.808433 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.813641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.814120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.814581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.815279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.815735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.816164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.835143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 11:59:30.913549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4862945f-d33d-4407-8109-9d99d9d897f3 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 204 len: 0 microversion: 2.1 time: 0.118511 Sep 12 11:59:30.914233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 447/898] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 11:59:30 2022] DELETE /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 11:59:30.923466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:30.924232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:30.930222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.930735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.931167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.931855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:30.932311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:30.932752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:30.960688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:30.969424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6785128e-4626-4112-a8d1-7afa3f0c014d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.167523 Sep 12 11:59:30.969994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 452/899] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:30 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:31.065812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:31.073535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae5e2fa8-d6f0-4c4f-86b3-5659b32b6a43 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1515 microversion: 2.1 time: 0.154992 Sep 12 11:59:31.074107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 448/900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:30 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:31.992365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:31.992968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:31.999592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:32.000068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:32.000505 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:32.001189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:32.001642 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:32.002097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:32.096982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:32.097598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:32.104001 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:32.104672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:32.105118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:32.105997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:32.106458 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:32.106919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:32.131707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:32.140786 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-53c081ea-cf15-4220-9f5b-3e5769454833 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.152241 Sep 12 11:59:32.141364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 453/901] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:31 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:32.244865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:32.252539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abe22051-ee8b-4b2f-97e0-1eac92847228 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1515 microversion: 2.1 time: 0.159369 Sep 12 11:59:32.253131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 449/902] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:32 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:33.165059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:33.165666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:33.172018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:33.172503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:33.172942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:33.173626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:33.174083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:33.174535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:33.275868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:33.277121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:33.283729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:33.284208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:33.284640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:33.285326 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:33.285777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:33.286193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:33.303705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:33.313187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16d16fb5-94ff-463c-8a59-6bcd2ae86334 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.151851 Sep 12 11:59:33.313761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 454/903] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:33 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:33.427225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:33.437129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6dd886cc-c21e-4820-93bf-08cf01dd3f6a tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1515 microversion: 2.1 time: 0.164696 Sep 12 11:59:33.438253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 450/904] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:33 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:33.901284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e247c23-36ae-485e-a832-199eb23191d4", "name": "network-vif-deleted", "tag": "756372de-6577-41d2-8e60-ade0a05e5082"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:33.911238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:33.911715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:33.912144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:33.923395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] Creating event network-vif-deleted:756372de-6577-41d2-8e60-ade0a05e5082 for instance 5e247c23-36ae-485e-a832-199eb23191d4 on hv-cinder-85331 Sep 12 11:59:33.928398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-90873b02-0d78-4e7c-b89d-5a1d2f3caacb req-0f005509-cb39-4610-a8f4-41128d453653 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091848 Sep 12 11:59:33.929348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 455/905] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 11:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 11:59:34.336199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:34.336842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:34.343961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:34.344441 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:34.344876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:34.345561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:34.346013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:34.346435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:34.462232 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:34.462948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:34.469654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:34.470138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:34.470603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:34.471297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:34.471753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:34.472206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:34.479273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:34.487813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7725e8da-79ba-4e52-a049-c95496e03030 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.155453 Sep 12 11:59:34.488387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 451/906] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:34 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:34.505504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:34.505989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:34.506427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:34.506907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lazy-loading 'fault' on Instance uuid 5e247c23-36ae-485e-a832-199eb23191d4 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 11:59:34.551274 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4b71a4e5c1a4656a541f9cacec0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01763b3d76492598530234d3b75ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:34.559387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-406c8ef5-0b10-4a6e-ac3e-2bbe53d846bf tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 200 len: 1309 microversion: 2.1 time: 0.101359 Sep 12 11:59:34.559945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 456/907] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:34 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:35.510408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:35.511022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:35.517637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:35.518123 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:35.518594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:35.519298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:35.519759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:35.520188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:35.583408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:35.584016 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] [instance: 5e247c23-36ae-485e-a832-199eb23191d4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:35.591068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:35.591552 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:35.591990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:35.592680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:35.593133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:35.593555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:35.607732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] HTTP exception thrown: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Request method failure captured: Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 HTTP/1.1 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx415kpFjXqoXtBMijtT-z30yzYhX-bpjlnI5J37yB7Ve5YpB9hRCLI0TFOjEBzet01_D1m66LzTmlbpi6QZJNl_syjAoNpOUiDEMKYPmrXd6HWD70wOLv0P7u464RZbMnl8hYwAfqvNnc_K_8a69G_i5L2dsekV5Joa9qojTE4TEno Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: ad01763b3d76492598530234d3b75ec8 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:59:35.609367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad01763b3d76492598530234d3b75ec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad01763b3d76492598530234d3b75ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad01763b3d76492598530234d3b75ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad01763b3d76492598530234d3b75ec8"}]}] Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: ad01763b3d76492598530234d3b75ec8 Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2100038787 Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotTestJSON-2100038787-project Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f4b71a4e5c1a4656a541f9cacec0af18 Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotTestJSON-2100038787-project Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. Sep 12 11:59:35.610852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '5e247c23-36ae-485e-a832-199eb23191d4'} Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:59:35.611688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. Sep 12 11:59:35.613062 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:35.614189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] Returning 404 to user: Instance 5e247c23-36ae-485e-a832-199eb23191d4 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:59:35.614189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cc42bcb-860e-427b-9c6a-8b4a4ec73070 tempest-VolumesSnapshotTestJSON-2100038787 tempest-VolumesSnapshotTestJSON-2100038787-project] 10.222.0.15 "GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4" status: 404 len: 111 microversion: 2.1 time: 0.031601 Sep 12 11:59:35.614189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 457/908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:35 2022] GET /compute/v2.1/servers/5e247c23-36ae-485e-a832-199eb23191d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 11:59:35.649501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:35.658353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1668ac58-4c1e-4dfd-ad78-c3c88a6616c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.151836 Sep 12 11:59:35.659076 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 452/909] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:35 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:36.681817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:36.682417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:36.689590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:36.690069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:36.690500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:36.691464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:36.691922 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:36.692346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:36.823935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:36.832088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-598b0976-28f0-4ba8-9a64-17e62a44f909 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.154108 Sep 12 11:59:36.832644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 458/910] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:36 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:37.856203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:37.856795 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:37.863171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:37.863644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:37.864070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:37.864746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:37.865192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:37.865612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:37.995237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:38.003456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-967a1ff2-89cc-42c0-83f7-af8f714eb20f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.151634 Sep 12 11:59:38.004236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 453/911] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:37 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:39.026820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:39.027567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:39.030082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=40 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:39.035623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:39.036104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:39.036543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:39.037234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:39.037690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:39.038118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:39.167588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:39.176260 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3632225d-2b00-4f54-80c7-ca37cba62416 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.153376 Sep 12 11:59:39.176811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 459/912] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:39 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:40.199642 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:40.200398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:40.206846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:40.207329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:40.207757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:40.208436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:40.208885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:40.209305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:40.335903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:40.344692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0c4a19b8-6d59-4d4b-a9fa-b56ac6eadb9e tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.149343 Sep 12 11:59:40.345261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 454/913] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:40 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:41.367876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:41.368475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:41.375809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:41.376410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:41.376940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:41.377716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:41.378174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:41.378625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:41.514684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:41.523025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36107588-e08a-4c63-9786-d57480b05281 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.159034 Sep 12 11:59:41.523588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 460/914] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:41 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:42.548752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:42.549406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:42.555803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:42.556285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:42.556718 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:42.569678 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:42.570194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:42.570784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:42.704287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:42.712635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4dcb49e6-f509-4c90-9cff-0ac6895669ee tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.168376 Sep 12 11:59:42.713205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 455/915] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:42 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 11:59:43.736743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:43.737355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:43.744673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:43.745160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:43.745603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:43.746352 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:43.746838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:43.747262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:43.878485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:43.886537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-582d4696-010d-4d83-9c5a-1778bc04c5a2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.153701 Sep 12 11:59:43.887132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 461/916] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:43 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:44.910538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:44.911175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:44.917500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:44.917985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:44.918648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:44.919337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:44.919788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:44.920213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:44.924384 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:45.067239 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:45.080542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d600e83-1f2d-4d61-b5ab-d6d492b9cc52 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.173737 Sep 12 11:59:45.081640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 456/917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:44 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:46.104390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:46.105000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:46.111330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:46.111818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:46.112255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:46.112953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:46.113410 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:46.113841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:46.248415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:46.256485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1012197d-4b4d-4357-ab71-0ec76fa3eb65 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.155922 Sep 12 11:59:46.257047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 462/918] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:46 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:47.279706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:47.281069 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:47.287881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:47.288391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:47.288827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:47.289671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:47.290228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:47.290718 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:47.441663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:47.449862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a45e6fff-f0ab-430a-8d66-30fd00383df1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.174621 Sep 12 11:59:47.450430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 457/919] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:47 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:48.474872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:48.475481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:48.482398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:48.482921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:48.483359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:48.484048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:48.484501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:48.484929 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:48.611093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:48.619233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56b18ccb-28a0-457e-af27-ca4ae554a799 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.148167 Sep 12 11:59:48.619798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 463/920] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:48 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:49.643247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:49.643856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:49.646155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:49.651480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:49.651903 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:49.652987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:49.653794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:49.654248 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:49.654709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:49.784382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:49.793525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c0f8bdbe-575c-466e-a20f-f770370e608f tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.153441 Sep 12 11:59:49.794093 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 458/921] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:49 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:50.816787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:50.817342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:50.824737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:50.825264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:50.825674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:50.826350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:50.826827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:50.827251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:50.954621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:50.962721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a2044c5-d741-4bea-a3a3-f380f400a152 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.149866 Sep 12 11:59:50.963284 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 464/922] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:50 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:51.986422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:51.987064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:51.993600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:51.994079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:51.994535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:51.995218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:51.995675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:51.997465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:52.125902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:52.134111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1516dd9f-f060-4948-b84d-30822b6a3f22 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.151549 Sep 12 11:59:52.134700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 459/923] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:51 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:53.159035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:53.159587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:53.166327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:53.167336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:53.167893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:53.168659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:53.169118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:53.169548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:53.297335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:53.305392 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d713d8b5-8352-4a87-ad20-344fe7ae0fc9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.150269 Sep 12 11:59:53.305951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 465/924] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:53 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:54.330237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:54.330962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:54.337342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:54.337822 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:54.338257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:54.338960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:54.339488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:54.339985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:54.471085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:54.479260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-245c00b5-66e5-4d32-b2ca-2e867f578bf2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.152844 Sep 12 11:59:54.479831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 460/925] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:54 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:55.505739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:55.506281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:55.513362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:55.513826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:55.514265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:55.514991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:55.515452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:55.515879 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:55.650802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:55.659354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-273d5a6e-80dc-463b-bd47-625b08261958 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1737 microversion: 2.1 time: 0.159846 Sep 12 11:59:55.659906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 466/926] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:55 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:56.684132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:56.684928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:56.691611 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:56.692172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:56.692615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:56.693293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:56.693741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:56.694158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:56.828005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:56.836356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dcedae41-e6b1-4800-b917-a6b18a6d1a94 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1717 microversion: 2.1 time: 0.156411 Sep 12 11:59:56.836935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 461/927] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:56 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:56.897861 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:56.898373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:56.904678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:56.905193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:56.905631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:56.906318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:56.906803 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:56.907233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:56.983222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 11:59:56.987736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] HTTP exception thrown: Cannot 'detach_volume' instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 while it is in vm_state rescued Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Request method failure captured: Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments/3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a HTTP/1.1 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2pk6V14JcYQLujBB4-HkiOoGyStG7TOyLJKTe_ZIU4APyDWKn0SP86S_McGOg4GujcFNCzKDMuTD-HiIz___jSXF5z45qU319_0Tv4ibuaQpqMgO1ScLbkuiVXVMFtC2Xmid0u8fK0DnuxI6OeRKbjnvxdEOOZv9k_HBesY3QlyJM Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 92efab98bce54b08899f057951b42617 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 11:59:56.989227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/92efab98bce54b08899f057951b42617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_92efab98bce54b08899f057951b42617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}] Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 92efab98bce54b08899f057951b42617 Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 66682d5656d3414eaebba666d4e0771f Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 11:59:56.990907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Cannot 'detach_volume' instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 while it is in vm_state rescued Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'server_id': 'e4186db1-608b-48ac-9c97-b6f35fa5bbc8', 'id': '3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a'} Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 11:59:56.991767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 while it is in vm_state rescued Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 while it is in vm_state rescued Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 11:59:56.993306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Returning 409 to user: Cannot 'detach_volume' instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 11:59:56.994651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c75b149-117e-457d-a1a0-28fcf7dcb93c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments/3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a" status: 409 len: 152 microversion: 2.1 time: 0.096799 Sep 12 11:59:56.994651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 467/928] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 11:59:56 2022] DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments/3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 11:59:57.000050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 11:59:57.000582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:57.006467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:57.007002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:57.007430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:57.008113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:57.008573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:57.008998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:57.074125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8c68bb60-233e-49e2-864d-67269bd19948 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/action" status: 202 len: 0 microversion: 2.1 time: 0.078269 Sep 12 11:59:57.074857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 462/929] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 11:59:56 2022] POST /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 11:59:57.083130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:57.083856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:57.090974 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:57.091585 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:57.091906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:57.092760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:57.093313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:57.093710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:57.302153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:57.311671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a39d828b-72fb-48f0-944a-93c937e14847 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1725 microversion: 2.1 time: 0.232529 Sep 12 11:59:57.312243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 468/930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:57 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:58.341237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:58.341925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:58.348082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:58.348563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:58.348992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:58.349668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:58.350114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:58.350560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:58.486276 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:58.494305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5a6c1f96-c841-4dea-8c8d-f8f8a8eae95b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1725 microversion: 2.1 time: 0.157931 Sep 12 11:59:58.494889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 463/931] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:58 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 11:59:59.518924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 11:59:59.519754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 11:59:59.527080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:59.527719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:59.528156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:59.528930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 11:59:59.529383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 11:59:59.529804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 11:59:59.693487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 11:59:59.702440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3df0713-f334-4306-9c41-19b9108c325b tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1725 microversion: 2.1 time: 0.187364 Sep 12 11:59:59.703045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 469/932] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 11:59:59 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:00.726221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:00.726868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:00.733956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:00.734443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:00.734931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:00.735634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:00.736092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:00.736520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:00.876598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:00.884891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-93789f7f-bf54-4458-b8a7-9fbed6e73d29 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1725 microversion: 2.1 time: 0.162692 Sep 12 12:00:00.885457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 464/933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:00 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:01.908495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:01.909108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:01.915490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:01.915981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:01.916427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:01.918630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:01.918630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:01.918906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:02.054025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:02.062403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80449eb2-5e9a-433a-a1a2-bef253dfb6c1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1731 microversion: 2.1 time: 0.157758 Sep 12 12:00:02.062994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 470/934] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:01 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:02.086152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:02.086667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:02.093787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:02.094274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:02.094755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:02.095443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:02.095894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:02.096318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:02.328770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7b9bb085-8e7b-4ef1-be66-df6c6348a983 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246328 Sep 12 12:00:02.329369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 465/935] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 12:00:02 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:03.315213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:03.325728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:03.326576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:03.327223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:03.341901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] Creating event network-changed:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 12:00:03.350227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-77cd275c-cd14-46a4-9cb0-ba93e7178670 req-a7385ff4-2db4-4809-aab8-b0b8f7cbec58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123422 Sep 12 12:00:03.352278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 471/936] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:05.365290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:05.374885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:05.375366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:05.375801 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:05.386376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] Creating event network-changed:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 12:00:05.391285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-48329f6a-fab8-493b-9a9d-8cebebeb4ac7 req-57707c4a-0a38-4472-bfa4-e36c9d1666c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030154 Sep 12 12:00:05.391841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 466/937] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:28.341845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=25 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:28.342837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=20 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:28.565557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:28.566141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:28.572143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.572629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.573067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.573750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.574208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.574668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.597208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6861191d-9f11-423c-94e1-ad0287173cd4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/ips" status: 200 len: 150 microversion: 2.1 time: 0.256982 Sep 12 12:00:28.597757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 472/938] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:00:28 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/ips => generated 150 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:00:28.608142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=17 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:28.608900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:28.613662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f980fc91-856a-4afc-9e51-63addea8e5e9"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:28.616052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:28.623575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.624055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.624483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.625157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.625603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.626016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.703946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/os-volume_attachments HTTP/1.1 Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 74 Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:00:28.705651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {"volumeAttachment": {"volumeId": "f980fc91-856a-4afc-9e51-63addea8e5e9"}} Sep 12 12:00:28.707381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'server_id': '8b230ba8-8256-43a9-ba1d-bd1167fd36bf', 'body': {'volumeAttachment': {'volumeId': 'f980fc91-856a-4afc-9e51-63addea8e5e9'}}} Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:28.708259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:28.709783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 400 to user: Invalid volume: volume f980fc91-856a-4afc-9e51-63addea8e5e9 is already attached to instances: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1dd2ab04-3e15-444c-bfbd-e46d97be2659 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100747 Sep 12 12:00:28.711213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 467/939] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:00:28 2022] POST /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:00:28.716255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:28.716779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:28.722533 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.723028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.723463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.724143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.724600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.725026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.749647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:00:28.823597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aaf87d42-2653-4296-a731-9800df71e62f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 204 len: 0 microversion: 2.1 time: 0.111079 Sep 12 12:00:28.824168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 473/940] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:00:28 2022] DELETE /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:00:28.832614 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:28.833225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:28.840177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.840659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.841097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.841787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:28.842240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:28.842722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:28.970714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:28.978462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90a35f83-c23f-461e-b280-98bf4d92bc26 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1682 microversion: 2.1 time: 0.149771 Sep 12 12:00:28.979101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 468/941] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:28 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:30.004234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:30.004965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:30.012022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:30.012526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:30.012942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:30.013626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:30.014078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:30.014504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:30.147793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:30.155631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e002528-41d7-467c-892c-c1b7fef0eea9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1682 microversion: 2.1 time: 0.155620 Sep 12 12:00:30.156203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 474/942] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:29 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:31.179131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:31.179927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:31.187275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.187275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.187522 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.188148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.188599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.189019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.324578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:31.330446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:31.330994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:31.333787 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b1f3327a-4b1f-48fe-bac4-be01ba0f64d1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1682 microversion: 2.1 time: 0.158689 Sep 12 12:00:31.334592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 469/943] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:31 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:31.337295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.337886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.338405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.339255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.339714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.340146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.370215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34550511-3113-48e3-b6d3-b45d7c4d8967 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments/fc622d56-8797-4215-ab32-dc363d27ac38" status: 200 len: 194 microversion: 2.20 time: 0.043653 Sep 12 12:00:31.370830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 475/944] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Sep 12 12:00:31 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments/fc622d56-8797-4215-ab32-dc363d27ac38 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 12:00:31.440816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:31.441359 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:31.447269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.447926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.448369 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.449058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.449513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.449935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.530090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lazy-loading 'services' on Instance uuid c07bfce9-613c-4147-b9c2-47f2ad345dc9 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:31.606002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3621f0fb-8a49-4ecd-a204-517b9a46a102 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments/fc622d56-8797-4215-ab32-dc363d27ac38" status: 202 len: 0 microversion: 2.20 time: 0.168994 Sep 12 12:00:31.606776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 470/945] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Sep 12 12:00:31 2022] DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments/fc622d56-8797-4215-ab32-dc363d27ac38 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:00:31.615419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:31.617738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:31.624148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.624715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.625152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.625934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.626425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.627318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.663926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21c054e3-5516-46b9-97de-881d9d191661 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047713 Sep 12 12:00:31.664647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 476/946] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 12 12:00:31 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 12:00:31.940969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b230ba8-8256-43a9-ba1d-bd1167fd36bf", "name": "network-vif-deleted", "tag": "9cab3842-6521-4349-b9ee-73997786a3bf"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:31.951528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:31.952001 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:31.952424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:31.964428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] Creating event network-vif-deleted:9cab3842-6521-4349-b9ee-73997786a3bf for instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf on hv-cinder-85331 Sep 12 12:00:31.969195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-d50a0932-363f-4ebf-8834-61d73ebe04d5 req-bddcf758-fede-4b03-8cf3-539c223f71bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Sep 12 12:00:31.969775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 471/947] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:32.358281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:32.360240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:32.370399 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:32.370912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:32.371343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:32.372040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:32.372488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:32.372908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:32.413153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:32.413632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:32.414065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:32.414506 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'fault' on Instance uuid 8b230ba8-8256-43a9-ba1d-bd1167fd36bf {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:32.457252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:32.466795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95ff5a4d-48ea-43dd-9613-8a3a1a3f7ed0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 200 len: 1332 microversion: 2.1 time: 0.113217 Sep 12 12:00:32.467374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 477/948] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:32 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:32.678449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:32.680706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:32.688139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:32.688855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:32.689455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:32.690309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:32.690959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:32.691533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:32.724472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-86a3cc5d-c933-45e4-9e82-298e5025b3cf tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050677 Sep 12 12:00:32.725526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 472/949] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 12 12:00:32 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 12:00:33.490006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:33.490643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:33.497491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.497966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.498395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.499099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.499548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.499971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.513010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf HTTP/1.1 Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:00:33.514659 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:00:33.516070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '8b230ba8-8256-43a9-ba1d-bd1167fd36bf'} Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:00:33.516829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:00:33.518056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:33.519209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:00:33.519209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dda75218-a708-493b-b5a5-82f402d3c9ef tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 404 len: 111 microversion: 2.1 time: 0.029843 Sep 12 12:00:33.519209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 478/950] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:33 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:00:33.524774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-247e11c0-a9a6-4273-b329-a13340fef7b9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '.version_select at 0x7fc93a1bab80>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:33.544352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-247e11c0-a9a6-4273-b329-a13340fef7b9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053704745" status: 202 len: 0 microversion: 2.1 time: 0.023290 Sep 12 12:00:33.545048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 473/951] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 12 12:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053704745 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:00:33.737936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:33.740230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:33.746843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.747324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.747756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.748444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.748893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.749313 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.778765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-047f0b43-759e-475a-8134-34d7f8f6ce3a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044751 Sep 12 12:00:33.779325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 479/952] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 12 12:00:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:33.852641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:33.853195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:33.860711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.861197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.861633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.862324 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.862805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.863231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.889937 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:00:33.974885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9befb721-f299-4dce-bf9b-82283bf83c9c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 204 len: 0 microversion: 2.20 time: 0.125489 Sep 12 12:00:33.975594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 474/953] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 12 12:00:33 2022] DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 12:00:33.984667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:33.985285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:33.991470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.991961 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.992403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:33.993106 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:33.993565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:33.993993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:34.152239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:34.162612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:34.164746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:34.166668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b8df0bf-b68b-44b5-a3e1-9a58326c6bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.185204 Sep 12 12:00:34.167715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 480/954] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:33 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:34.493240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:34.493829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:34.500422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:34.500911 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:34.501360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:34.502051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:34.502530 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:34.502964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:34.582592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'services' on Instance uuid 1e2d709d-f003-488e-9bb0-bfb75d0f69ab {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:34.652795 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f588a210-0e87-480d-b008-9a41b2d98b3d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments/f980fc91-856a-4afc-9e51-63addea8e5e9" status: 202 len: 0 microversion: 2.1 time: 0.163743 Sep 12 12:00:34.653385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 475/955] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:00:34 2022] DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments/f980fc91-856a-4afc-9e51-63addea8e5e9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 12:00:34.661635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:34.663812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:34.670460 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:34.670971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:34.671406 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:34.672085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:34.672537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:34.672960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:34.702802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68d427aa-5580-4e8e-93a5-4f7fc06279df tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Sep 12 12:00:34.703353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 481/956] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:00:34 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:35.198421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:35.199138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:35.205247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:35.205722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:35.206150 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:35.206865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:35.207311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:35.207731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:35.342076 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:35.350870 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:35.352305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:35.353571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-591178e3-ad2d-4699-aa6a-a7f4fa17c8a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.160008 Sep 12 12:00:35.354598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 476/957] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:35 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:35.715624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:35.717650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:35.723915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:35.724387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:35.724816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:35.725491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:35.725939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:35.726359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:35.755526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f81057e-4027-4037-98ab-dbc9e882e282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Sep 12 12:00:35.756153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 482/958] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:00:35 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:36.380440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:36.381204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:36.388260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.388743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.389175 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.389861 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.390385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.390833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.524670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:36.533633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:36.535344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:36.536523 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b676504b-2bb1-4553-af1b-d2db58183902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1721 microversion: 2.20 time: 0.160174 Sep 12 12:00:36.537275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 477/959] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:36 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:36.769069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:36.771303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:36.777787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.778270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.778779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.779477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.779936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.780371 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.812165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86a8b64a-21bd-4b15-b638-2cd81f9264e1 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048035 Sep 12 12:00:36.812740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 483/960] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:00:36 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:00:36.876022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:36.876543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:36.882607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.883097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.883535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.884220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:36.884734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:36.885448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:36.911038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:00:36.998959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-171c5bc4-f6a1-437a-8a2f-cc8de2b253a7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 204 len: 0 microversion: 2.1 time: 0.126472 Sep 12 12:00:36.999985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 478/961] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:00:36 2022] DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:00:37.007880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:37.008754 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:37.015832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.016381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.016906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.017667 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.018225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.018748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.026380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07bfce9-613c-4147-b9c2-47f2ad345dc9", "name": "network-vif-deleted", "tag": "7163d32b-1c89-447a-a52f-3d1f0d3e3c2e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:37.036764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.037243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.037677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.049327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] Creating event network-vif-deleted:7163d32b-1c89-447a-a52f-3d1f0d3e3c2e for instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 on hv-cinder-85331 Sep 12 12:00:37.054365 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-0001090e-a327-4e08-b9e7-0a79a2520bf0 req-e4079a43-aada-4c1a-9587-1b2875b4a5e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Sep 12 12:00:37.055124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 479/962] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:00:37.180241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:37.188953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bfe2264-3b8d-493a-aef0-d36db0ace4b7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1681 microversion: 2.1 time: 0.184806 Sep 12 12:00:37.190130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 484/963] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:37 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:37.563282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:37.564106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:37.570197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.570713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.571153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.571851 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.572906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.573541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.606146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:37.606922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:37.607516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:37.607968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lazy-loading 'fault' on Instance uuid c07bfce9-613c-4147-b9c2-47f2ad345dc9 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:37.658204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:37.661835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:37.667883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:37.669342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:37.671471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-018d0bc2-171e-48c1-a7ee-e7d837d603b8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 200 len: 1370 microversion: 2.20 time: 0.113212 Sep 12 12:00:37.672035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 480/964] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:37 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:38.213350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:38.213954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:38.220491 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:38.220966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:38.221394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:38.222075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:38.222538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:38.222959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:38.476222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:38.485824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0814e441-2d79-40d3-b9c1-710c76fe8282 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1681 microversion: 2.1 time: 0.276277 Sep 12 12:00:38.486920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 485/965] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:38 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:38.697396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:38.698204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:38.705845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:38.706415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:38.707000 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:38.707764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:38.708327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:38.708848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:38.723181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 HTTP/1.1 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:00:38.724854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:00:38.726564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'c07bfce9-613c-4147-b9c2-47f2ad345dc9'} Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:00:38.727496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:00:38.729763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:00:38.731927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:00:38.731927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-df51e7e1-5cdc-48a1-b390-cd7eec48d60a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 404 len: 111 microversion: 2.20 time: 0.032834 Sep 12 12:00:38.731927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 481/966] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:38 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:00:38.736180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6660de6-cf1e-4164-af9a-c2867a5a37ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '.version_select at 0x7fc93a43ba60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:38.756912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6660de6-cf1e-4164-af9a-c2867a5a37ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927605939" status: 204 len: 0 microversion: 2.20 time: 0.024395 Sep 12 12:00:38.757834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 486/967] 10.222.0.15 () {60 vars in 1259 bytes} [Mon Sep 12 12:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927605939 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 12:00:39.072444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2d709d-f003-488e-9bb0-bfb75d0f69ab", "name": "network-vif-deleted", "tag": "b25efa2e-fad4-493f-9130-67c7da820a60"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:39.090853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:39.091486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:39.092026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:39.115392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] Creating event network-vif-deleted:b25efa2e-fad4-493f-9130-67c7da820a60 for instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab on hv-cinder-85331 Sep 12 12:00:39.121802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-1634ff47-1bee-4c36-af99-47e32562f7c2 req-76c59529-6916-480c-aad2-e7a8eb4c982a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052946 Sep 12 12:00:39.124372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 482/968] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:39.487535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5dbebb4a-72f0-4796-9a43-d4634c62d946 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: .version_select at 0x7fc93a3a0940>, body: {"keypair": {"name": "tempest-keypair-975825599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ023G489qRqI80cp6nzu+h6brlwl3olGV7sOhLvlQGh7/WGAfrcS9aXDyWyN7kk2OcdQgWZFejElLXPA4Ltj+hVWK9ObgUG3NdA8c6smwaBmt0IRMtbPmd+dRz4wPiM+A=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:39.509207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-5dbebb4a-72f0-4796-9a43-d4634c62d946 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for project 0356e6690066437a86fc69833ff4cb69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:00:39.510743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:39.511578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:39.513318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-5dbebb4a-72f0-4796-9a43-d4634c62d946 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for user 6e3c1f7f6f8649a991d5d8a15eb8826b and project 0356e6690066437a86fc69833ff4cb69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:00:39.517842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:39.518335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:39.518802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:39.519499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:39.519980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:39.520575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:39.535971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5dbebb4a-72f0-4796-9a43-d4634c62d946 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052419 Sep 12 12:00:39.538839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 487/969] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Sep 12 12:00:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 12:00:39.553975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:39.554464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:39.555100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:39.555555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'fault' on Instance uuid 1e2d709d-f003-488e-9bb0-bfb75d0f69ab {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:39.606548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:39.620641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ebf05fc9-245d-49c0-9802-2123d8c2ddae tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 200 len: 1332 microversion: 2.1 time: 0.114681 Sep 12 12:00:39.626652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 483/970] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:39 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:40.647700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:40.648343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:40.654591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:40.655081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:40.655522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:40.656217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:40.656672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:40.657102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:40.670683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab HTTP/1.1 Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:00:40.672217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:00:40.673785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '1e2d709d-f003-488e-9bb0-bfb75d0f69ab'} Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:00:40.674915 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:00:40.676307 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:00:40.677886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:00:40.677886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-feb1ab63-ea9d-41e5-9099-ed7ccd12a83b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 404 len: 111 microversion: 2.1 time: 0.030449 Sep 12 12:00:40.677886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 488/971] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:40 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:00:40.683746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f4385efa-526c-4cc8-8d0b-0f79c0367b06 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '.version_select at 0x7fc93a2360d0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:40.704467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f4385efa-526c-4cc8-8d0b-0f79c0367b06 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252202419" status: 202 len: 0 microversion: 2.1 time: 0.025716 Sep 12 12:00:40.705153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 484/972] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 12 12:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252202419 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:00:40.911057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1767876738", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17b03ad-5779-44c1-a615-ac6df97b3bc7"}], "security_groups": [{"name": "tempest-securitygroup--1218941806"}], "key_name": "tempest-keypair-975825599", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:41.087036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] validate_networks() for [('e17b03ad-5779-44c1-a615-ac6df97b3bc7', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:00:41.770049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:41.770872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:41.778663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:41.779147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:41.779583 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:41.780276 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:41.780730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:41.781158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:41.886055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lazy-loading 'services' on Instance uuid 7bff9ca9-92fa-4ad9-867f-4f889d1261bc {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:00:41.967588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:00:41.968113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:00:41.968476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:00:41.968885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:00:41.969476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:00:41.972977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c13d106-54f7-4c09-acf1-5bd4b04f5837 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments/f2853400-660e-4490-bf67-ba5d9f46420c" status: 202 len: 0 microversion: 2.1 time: 0.323983 Sep 12 12:00:41.973654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 485/973] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:00:41 2022] DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments/f2853400-660e-4490-bf67-ba5d9f46420c => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 12:00:41.985865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-81ba4c96-7013-44d6-89b5-2a5fd55a276f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: .version_select at 0x7fc93a234f70>, body: {"keypair": {"name": "tempest-keypair-1317349004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETnUaA/heglyaRXzqc5ETUt5pd6ccn1AG/akZ9vHeYKpw85Dbymj+BVFbveblB5bS5uikq/PiT45j/mMg7mz5afQeNwGF3zGPV52GYdbcWav7UurEYeyZpsJs6TPSESaQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:41.997926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:41.998413 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:42.002886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-81ba4c96-7013-44d6-89b5-2a5fd55a276f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:00:42.004390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:42.005145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:42.005640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:42.006075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:42.006984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-81ba4c96-7013-44d6-89b5-2a5fd55a276f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:00:42.024199 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for project 0356e6690066437a86fc69833ff4cb69. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:00:42.029479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Getting quotas for user 6e3c1f7f6f8649a991d5d8a15eb8826b and project 0356e6690066437a86fc69833ff4cb69. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:00:42.042388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:00:42.045389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:00:42.049088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-81ba4c96-7013-44d6-89b5-2a5fd55a276f tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073927 Sep 12 12:00:42.050146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 486/974] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 12:00:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:42.102243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61b6e171-bcca-4806-b868-37e463838bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.195581 Sep 12 12:00:42.103309 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 489/975] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Sep 12 12:00:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 12:00:42.115169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:42.116362 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:42.188147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:42.197507 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:42.198982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:42.200432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e85e7e14-e3ff-4d1c-aa2a-22ebe911f206 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1281 microversion: 2.20 time: 0.089724 Sep 12 12:00:42.201494 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 487/976] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:42 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:00:43.129275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:43.139470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:43.141068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:43.141441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:43.217105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 12:00:43.221639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:43.226309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:43.227471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:43.234335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:43.234985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:43.235724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:43.236533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:43.236991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:43.237695 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:43.264416 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6677fc65-0b98-4661-b118-5421d8c82c62 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action" status: 202 len: 0 microversion: 2.1 time: 0.139284 Sep 12 12:00:43.265768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 490/977] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:00:43 2022] POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:00:43.275621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:43.276544 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:43.282935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:43.283414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:43.283852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:43.284540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:43.284990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:43.285412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:43.352448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:43.361932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:43.363468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:43.364833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cfb01576-dcf1-41d6-9db6-5c74540034de tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1333 microversion: 2.20 time: 0.143361 Sep 12 12:00:43.379553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 488/978] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:43 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:43.438195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:43.446171 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af4f5d9b-bb27-4026-9de5-487be589f934 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.176143 Sep 12 12:00:43.447300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 491/979] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:43 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:43.455227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-911018923", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea7071fe-73d4-4a9c-bf82-37346c7e58c4"}], "security_groups": [{"name": "tempest-securitygroup--1274116972"}], "key_name": "tempest-keypair-1317349004", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:43.563818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] validate_networks() for [('ea7071fe-73d4-4a9c-bf82-37346c7e58c4', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:00:44.001727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:00:44.002155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:00:44.002717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:00:44.003135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:00:44.003547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:00:44.012866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.013314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.013750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.014473 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.014957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.015382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.031804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:00:44.036018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:00:44.047585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:00:44.049881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:00:44.099104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ec9de083-0a9b-48e3-a0f9-c5f3ef3bbc72 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649531 Sep 12 12:00:44.100096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 489/980] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:00:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 12:00:44.111879 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bdf4d284-01a7-44f2-9f8d-a2de316ded70 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:44.112728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bdf4d284-01a7-44f2-9f8d-a2de316ded70 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:44.180293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bdf4d284-01a7-44f2-9f8d-a2de316ded70 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:44.188807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bdf4d284-01a7-44f2-9f8d-a2de316ded70 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1241 microversion: 2.1 time: 0.081086 Sep 12 12:00:44.190435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 492/981] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:44 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:44.393002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:44.394110 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:44.404621 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.405750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.406838 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.409983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.410936 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.411597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.471926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:44.472751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:44.480664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.481420 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.482029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.483134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:44.484124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:44.485049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:44.623893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:44.636681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:44.639900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:44.641088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-499db521-f569-4138-a0d5-88a905213942 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.253472 Sep 12 12:00:44.642160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 490/982] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:44 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:44.730384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:44.738746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5598be6d-9a71-4e88-b7a8-ba16d66ed7ba tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.272360 Sep 12 12:00:44.739312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 493/983] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:44 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:45.212692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:45.213306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:45.219273 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.219760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.220193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.220890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.221375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.221806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.283601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:45.292167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ef9baee9-aee1-4b1b-89c5-1f9453eb984c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1293 microversion: 2.1 time: 0.083871 Sep 12 12:00:45.292814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 491/984] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:45 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:45.300843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:45.314551 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.315199 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.315648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.327282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] Creating event network-changed:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:00:45.332306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-19f10c10-92e9-415e-afb5-97788bba0571 req-b7be9fe7-7a2c-4577-b978-6ddbc522d89c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Sep 12 12:00:45.333065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 494/985] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:45.668469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:45.669132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:45.672547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:45.676381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.676856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.677288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.677970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.678419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.678864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.770078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:45.770926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:45.778140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.778927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.779369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.780072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:45.780527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:45.781101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:45.828295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:45.836314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:45.838634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:45.839760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de4cf835-f130-4231-a778-425c583b8757 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.176031 Sep 12 12:00:45.840345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 492/986] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:45 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:46.096144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:46.104863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b891240a-0035-4885-ad1d-5d36f3fbee7e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.338973 Sep 12 12:00:46.105458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 495/987] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:45 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:46.315518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:46.316126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:46.322650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:46.323133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:46.323573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:46.324250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:46.324699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:46.325126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:46.390124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:46.397886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-61a5768f-fa3f-497b-8531-4fac3b9c389b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1299 microversion: 2.1 time: 0.086215 Sep 12 12:00:46.398456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 493/988] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:46 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:46.865302 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:46.865948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:46.873144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:46.873634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:46.874105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:46.874836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:46.875294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:46.875721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:47.003023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:47.011126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:47.012579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:47.013674 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc87c375-c591-4495-a2bd-7f01b64188fe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.152333 Sep 12 12:00:47.014227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 496/989] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:46 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:47.133025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:47.133634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:47.140103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:47.140581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:47.141014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:47.141694 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:47.142174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:47.142626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:47.276411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:47.284814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e48150c4-54f5-44c5-ac36-56cf723ac7dd tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.155630 Sep 12 12:00:47.285392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 494/990] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:47 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:47.421926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:47.422690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:47.428579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:47.429064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:47.429503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:47.430191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:47.430698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:47.431115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:47.558425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:47.566039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-515575e1-e17f-4bd1-8052-e07985e97f43 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.147992 Sep 12 12:00:47.566622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 497/991] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:47 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:48.038357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:48.039025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:48.045140 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.045630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.046068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.046782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.047243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.047670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.177136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:48.186301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:48.187902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:48.188996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7c6c7bdf-adf0-4803-9b85-37b4bbffc700 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.154694 Sep 12 12:00:48.189586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 495/992] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:48 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:48.309465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:48.310001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:48.316450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.316934 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.317369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.318056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.318532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.318959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.588623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:48.588807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:48.589181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:48.595368 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.595860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.596307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.596591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f197b68-1031-41fe-b39a-640694f8db1e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.291880 Sep 12 12:00:48.597010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:48.597453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 498/993] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:48 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:48.607024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:48.607508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:48.745708 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:48.753351 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-766bb410-9529-4b6a-9872-1ba514ccbc40 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.168694 Sep 12 12:00:48.753918 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 496/994] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:48 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:49.214098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:49.214750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:49.223380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.223778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.224228 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.225223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.225393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.225821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.426074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:49.435349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:49.437008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:49.438152 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a220201-25e7-4ea0-846c-4973dd1950ae tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.228025 Sep 12 12:00:49.438973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 499/995] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:49 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:49.502984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66e13ac-f5d7-4903-afbd-8a6059142cec", "tag": "1402bb0d-8139-4b30-90be-b71437aa2652"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:49.514957 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.515882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.516537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.529383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] Creating event network-changed:1402bb0d-8139-4b30-90be-b71437aa2652 for instance f66e13ac-f5d7-4903-afbd-8a6059142cec on hv-cinder-85331 Sep 12 12:00:49.534956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-c2771028-508a-435f-864d-d7173290c210 req-c57e8d4b-0e3c-4585-8a95-ae805b55e4cc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035698 Sep 12 12:00:49.535576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 497/996] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:00:49.623732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:49.624375 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:49.630342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.630868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.631328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.632000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.632455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.632885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.778503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:49.779227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:49.785625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.786114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.786578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.787285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:49.787742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:49.788170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:49.924480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:49.933116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6cfe74c3-f785-4d2d-a89d-5d2fa8fbd552 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.159340 Sep 12 12:00:49.933704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 498/997] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:49 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:50.089832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:50.098250 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e827c32a-355b-4ed9-a86f-ddf3b6dddf33 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.478401 Sep 12 12:00:50.098869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 500/998] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:49 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:50.464339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:50.465114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:50.471072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:50.471552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:50.471982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:50.472655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:50.473105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:50.473557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:50.603768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:50.611846 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:50.613285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:50.614385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-880a863b-4143-4a8f-9f7f-3e154908e33b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.154910 Sep 12 12:00:50.614991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 499/999] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:50 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:50.956623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:50.957253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:50.963993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:50.964479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:50.964918 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:50.965609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:50.966065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:50.966497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.092535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:51.100019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9fb87832-fdad-4656-9f2e-5e07a42af4c2 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.147445 Sep 12 12:00:51.100586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 501/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:50 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:51.127122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:51.127775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:51.134377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:51.134888 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:51.135330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.136024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:51.136484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:51.136916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.272088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:51.280101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-899e48d0-ce25-4651-9d71-b5b6bfa121aa tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.156816 Sep 12 12:00:51.280778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 500/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:51 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:51.369291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "name": "network-vif-plugged", "status": "completed", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:51.375826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:51.381099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:51.381603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:51.382025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.397924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] Creating event network-vif-plugged:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:00:51.403005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c8c4ef79-6202-43e1-87cc-dee8ad70c3d2 req-667982ea-95b7-4972-b312-d72214eefe9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037927 Sep 12 12:00:51.403817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 502/1002] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:51.639984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:51.640605 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:51.647388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:51.647901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:51.648336 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.649053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:51.650263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:51.650736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:51.780496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:51.788506 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:51.790015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:51.791223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1e23d783-07c2-44f6-9e0d-2d27c19a19a7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.155201 Sep 12 12:00:51.791784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 501/1003] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:51 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:52.121178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:52.125348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:52.126039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:52.133331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.134543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.135055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.135736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.136181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.136603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.269364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:52.277161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d93be86e-e37d-48c4-a676-adc4c4f77c29 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.158344 Sep 12 12:00:52.277722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 503/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:52 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:52.303176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:52.303792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:52.310835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.311324 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.311767 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.312467 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.312931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.313361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.317357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:52.444285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:52.451986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c4f68b90-a977-4440-bf9c-48f15ce11d5b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.152629 Sep 12 12:00:52.452550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 502/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:52 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:52.818226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:52.818857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:52.824988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.825727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.826386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.827543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:52.828238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:52.828884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:52.959698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:52.968240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:52.969700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:52.970825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dac560e3-e15d-4d16-ad4b-c8a35aa78638 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.156484 Sep 12 12:00:52.971383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 504/1006] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:52 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:53.299873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:53.300619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:53.307826 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:53.308323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:53.308756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:53.309434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:53.309892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:53.310310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:53.446301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:53.454878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fbb03178-06b6-4d26-a0c3-8603561bc3f7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.158799 Sep 12 12:00:53.455454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 503/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:53 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:53.474617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:53.475279 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:53.481916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:53.482401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:53.482871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:53.483562 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:53.484020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:53.484454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:53.611815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:53.619951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-874e7236-83a9-4bb3-b125-c6efc1520d84 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.149143 Sep 12 12:00:53.620521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 505/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:53 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:53.997128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:53.997731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:54.003677 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.004151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.004582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.005259 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.005707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.006129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.023549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:54.043557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=12 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:54.138706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:54.146882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:54.148318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:54.150046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-912bbb1a-1d0f-4be3-8060-4d7d219b6380 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.158416 Sep 12 12:00:54.150626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 504/1009] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:53 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:54.478238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:54.478880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:54.480709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:54.486807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.487299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.487741 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.488439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.488925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.489354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.619587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:54.627088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33a9a3d7-eda5-48d2-a460-49a814a63bc5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.152793 Sep 12 12:00:54.627654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 506/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:54 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:54.642911 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:54.643528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:54.650405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.650919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.651361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.652043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:54.652499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:54.652924 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:54.778912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:54.786582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a75caa3f-8ee0-440e-8df9-c0d55f7d396a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.147507 Sep 12 12:00:54.787146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 505/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:54 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:55.174033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:55.174669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:55.180856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.181376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.181819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.182800 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.183258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.183688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.313013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:55.321398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:55.322862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:55.323960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86df6f70-bd24-4551-8a5b-0ff182dbc1c1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.153851 Sep 12 12:00:55.324510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 507/1012] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:55 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:55.650374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:55.651016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:55.657426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.657917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.658360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.659083 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.659547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.659982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.798296 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:55.806833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-255f2a7f-42ce-430f-a350-4657c363a2f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.160898 Sep 12 12:00:55.807658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 506/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:55 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:55.811566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:55.812183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:55.818864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.819344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.819779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.820465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:55.821003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:55.821450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:55.952603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:55.955920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:00:55.960909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef8bbe15-c3ec-4174-920e-ce796d7f98c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.153248 Sep 12 12:00:55.962180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 508/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:55 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:56.348906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:56.349563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:56.355914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.356409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.356882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.357582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.358038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.358566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.423115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66e13ac-f5d7-4903-afbd-8a6059142cec", "name": "network-vif-plugged", "status": "completed", "tag": "1402bb0d-8139-4b30-90be-b71437aa2652"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:56.435959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.436615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.437283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.451819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] Creating event network-vif-plugged:1402bb0d-8139-4b30-90be-b71437aa2652 for instance f66e13ac-f5d7-4903-afbd-8a6059142cec on hv-cinder-85331 Sep 12 12:00:56.458335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-79c49053-0a11-49bb-8df4-45f161c83f56 req-e3880f8c-11e9-44a3-9393-b11c863c5d67 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038978 Sep 12 12:00:56.459403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 509/1015] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:56.497543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:56.506477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:56.510120 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:56.511274 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d79879b-9847-4048-82b5-e8c96ca2defe tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1407 microversion: 2.20 time: 0.166471 Sep 12 12:00:56.512173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 507/1016] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:56 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:56.829983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:56.830697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:56.837933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.838407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.838863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.839541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.839990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.840409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.965750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:56.973251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d31355ff-27f5-4cd4-9e3d-083c4472e73b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.147736 Sep 12 12:00:56.973808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 510/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:56 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:00:56.984609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:56.985221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:56.991486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.991960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.992391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:56.993601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:56.994071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:56.994477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:57.121101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:57.128871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-302eb54a-6d1f-4589-8890-2d9cb188dbb5 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.148040 Sep 12 12:00:57.129560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 508/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:56 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:57.537273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:57.537879 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:57.544587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:57.545076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:57.545517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:57.546207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:57.546697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:57.547120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:57.672081 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:57.680753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:57.682620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:57.683820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46e676c3-fa05-4e1a-b5c3-c060b0779f91 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1599 microversion: 2.20 time: 0.150513 Sep 12 12:00:57.684380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 511/1019] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:00:57 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:00:57.708294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:57.708783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:57.714943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:57.715445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:57.715906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:57.716580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:57.717026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:57.717446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:57.799809 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dcad11b0-c6bd-49f0-9384-7533d16ec8d1 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095378 Sep 12 12:00:57.800410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 509/1020] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Sep 12 12:00:57 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 12:00:57.996625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:57.997150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:58.003433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:58.003912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:58.004343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:58.005031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:58.005481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:58.005919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:58.150643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:58.153588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:58.154198 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:58.159172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e05ce44-1c08-453d-b1cf-d3ec726aedd9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1367 microversion: 2.1 time: 0.167143 Sep 12 12:00:58.159980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 512/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:57 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:58.160131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:58.160514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:58.160946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:58.161634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:58.162082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:58.162500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:58.404545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:58.412310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a9d2ffa1-1f39-4759-91e1-5ad23b65966c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.263356 Sep 12 12:00:58.412876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 510/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:58 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:59.050993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:00:59.061320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.061877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.062384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.073791 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] Creating event network-changed:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:00:59.078630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-07e8e05d-35fd-4095-a61e-9d61974617d5 req-7829f1c4-5063-487d-b434-0a4784626e4c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Sep 12 12:00:59.079320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 513/1023] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:00:59.184504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:59.185280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:59.192566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.193139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.193643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.194827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.194973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.195297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.335392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:59.344586 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ef7c86a3-5ca6-4af3-9dab-0cd557e1a630 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1557 microversion: 2.1 time: 0.164949 Sep 12 12:00:59.345178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 511/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:59 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:00:59.368917 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:59.369488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:59.375613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.376128 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.376509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.377206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.377658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.378080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.437064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:00:59.437597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:00:59.443385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.443987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.444433 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.445119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:00:59.446249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:00:59.446926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:00:59.462034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58687032-b4c1-401c-82a9-c1aad81c9778 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097359 Sep 12 12:00:59.463714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 514/1025] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 12:00:59 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:00:59.705840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:00:59.715889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d9a6910d-2779-480d-aec8-081d6b29087d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.282988 Sep 12 12:00:59.716661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 512/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:00:59 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:00.740564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:00.741352 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:00.748066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:00.748715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:00.749223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:00.750060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:00.750607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:00.751123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:00.900168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:00.908407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43cddd87-ead9-469f-b4f1-cb71b2c68de9 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.172229 Sep 12 12:01:00.909019 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 515/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:00 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:01.094639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66e13ac-f5d7-4903-afbd-8a6059142cec", "tag": "1402bb0d-8139-4b30-90be-b71437aa2652"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:01.105336 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:01.105819 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:01.106253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:01.119301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] Creating event network-changed:1402bb0d-8139-4b30-90be-b71437aa2652 for instance f66e13ac-f5d7-4903-afbd-8a6059142cec on hv-cinder-85331 Sep 12 12:01:01.124648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-8bd48f06-f246-40cd-aa24-ae352b01928d req-f4f873df-d22b-4c96-926e-59cafc1c490a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Sep 12 12:01:01.125652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 513/1028] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:01.933785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:01.934391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:01.941101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:01.941581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:01.942045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:01.942759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:01.943212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:01.943644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:02.072892 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:02.080902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eff7989c-1656-4a7c-b986-c88ac8848ca2 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.151230 Sep 12 12:01:02.081464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 516/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:01 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:03.106308 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:03.107040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:03.113187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.113670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.114109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.114825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.115280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.115704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.250133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:03.258674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c9d4d778-e39b-4eed-aa42-cf6367e43ec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.156538 Sep 12 12:01:03.259246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 514/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:03 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:03.542236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:03.542972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:03.552900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.553751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.554572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.556234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.556957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.557388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.732602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:01:03.805554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be7a6e3c-0faf-47b5-a474-41e6e8579eaf tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "DELETE /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 204 len: 0 microversion: 2.1 time: 0.267875 Sep 12 12:01:03.806088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 517/1031] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:01:03 2022] DELETE /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 12:01:03.814747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:03.815385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:03.821427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.821915 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.822354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.823062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:03.823525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:03.823946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:03.954314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:03.962461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7bc3c79b-af36-42e0-a514-13fb8338eb1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1577 microversion: 2.1 time: 0.151700 Sep 12 12:01:03.963045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 515/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:03 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:04.282270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:04.283008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:04.288846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:04.289403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:04.289840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:04.291133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:04.291133 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:04.291606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:04.422673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:04.430364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2876c97-9f7b-4206-9cb0-d330ffd89f11 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1677 microversion: 2.1 time: 0.152203 Sep 12 12:01:04.430951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 518/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:04 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:04.986702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:04.987316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:04.993933 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:04.994412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:04.994900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:04.995589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:04.996046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:04.996474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.131215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:05.139609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-612cbd62-4899-4d98-8c52-6442f6abe597 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1577 microversion: 2.1 time: 0.156755 Sep 12 12:01:05.140184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 516/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:04 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:05.454287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:05.454916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:05.462088 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:05.462595 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:05.463031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.463717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:05.464170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:05.464595 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.594919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:05.603185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cc09974-0fcc-40e6-9e2c-f33459517e5c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1654 microversion: 2.1 time: 0.152632 Sep 12 12:01:05.603739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 519/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:05 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:05.625469 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:05.631396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:05.631881 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:05.632320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.656376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Going to try to start instance {{(pid=120424) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 12:01:05.696679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-740624ad-02ce-44bf-8dea-9590f895306f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action" status: 202 len: 0 microversion: 2.1 time: 0.074306 Sep 12 12:01:05.697265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 517/1036] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:01:05 2022] POST /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:01:05.705412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:05.705961 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:05.713109 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:05.713609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:05.714063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.714793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:05.715266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:05.715698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:05.955626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:05.963386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d232e82-1586-4830-89a7-b5904f6fbec6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1663 microversion: 2.1 time: 0.261899 Sep 12 12:01:05.963983 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 520/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:05 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1663 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:06.164007 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:06.165071 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:06.171199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:06.171685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:06.172117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:06.172812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:06.173269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:06.173703 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:06.312295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:06.315986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:06.322923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6cbc96db-be32-483d-a0c0-d48f66c6f7ab tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1577 microversion: 2.1 time: 0.163584 Sep 12 12:01:06.323661 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 518/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:06 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:06.987191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:06.987762 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:06.994604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:06.995110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:06.995552 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:06.996269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:06.996732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:06.997167 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:07.284118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14981185-c481-469f-82d7-e05a3cc0ee87", "name": "network-vif-deleted", "tag": "1a736c65-ac60-4402-a1ca-e68a2f82f8cf"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:07.295570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:07.296055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:07.296486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:07.309373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] Creating event network-vif-deleted:1a736c65-ac60-4402-a1ca-e68a2f82f8cf for instance 14981185-c481-469f-82d7-e05a3cc0ee87 on hv-cinder-85331 Sep 12 12:01:07.313997 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:07.314505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-6bdd8098-0b51-4e03-8915-50667968762f req-5e283231-7a1b-4347-8376-1e3d5b12cde4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Sep 12 12:01:07.315134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 519/1039] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:01:07.332895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d56fc164-c8f9-4fd6-aa89-f1f34f1fe9c7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1663 microversion: 2.1 time: 0.349573 Sep 12 12:01:07.333699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 521/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:06 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1663 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:07.350750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:07.352256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:07.360303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:07.360963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:07.361561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:07.363628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:07.364268 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:07.364934 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:07.432913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:07.440709 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f93df757-213d-4404-b663-2bb70a46d849 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1510 microversion: 2.1 time: 0.096008 Sep 12 12:01:07.441284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 520/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:07 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:08.355926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:08.356542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:08.362834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:08.363345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:08.363776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:08.364458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:08.364910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:08.365332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:08.464573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:08.465466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:08.471847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:08.472330 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:08.472763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:08.473451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:08.473906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:08.474329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:08.501671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:08.508922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:08.509413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:08.510043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:08.510302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lazy-loading 'fault' on Instance uuid 14981185-c481-469f-82d7-e05a3cc0ee87 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:01:08.511489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9654f215-f8eb-4287-b432-6327f73eb560 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1667 microversion: 2.1 time: 0.159302 Sep 12 12:01:08.512165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 522/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:08 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:08.552186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:08.560886 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cccb65d1-447b-4886-be87-a87f9596b518 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 200 len: 1231 microversion: 2.1 time: 0.101074 Sep 12 12:01:08.561477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 521/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:08 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:09.584617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:09.585158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:09.593077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.593561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.594002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.594755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.595216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.595655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.609059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] HTTP exception thrown: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Request method failure captured: Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 HTTP/1.1 Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx5RJHIuNoYoV7TOMZkTUmau9hPHd_llyLF_0xDTRbZ5oWSh5QOTESQGL-B9CnXr0iBLYxWG8VvvxFkOYCAuzn_CKLPWR7WJNQPMvodpO1Vchby4oAb6zapZiFhNoYKBcSPx6d1KBOJJaTvGtYeNgNbeAuD7Um16aImiaWIWZcRXngM Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:01:09.610728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}] Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-188456415 Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: fb4bb9cd41cd46ddb87a746e732a948f Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:01:09.612328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '14981185-c481-469f-82d7-e05a3cc0ee87'} Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:01:09.613308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:01:09.614645 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:09.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Returning 404 to user: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:01:09.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bed4546-4023-40fd-baf0-b8006e88a3e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 404 len: 111 microversion: 2.1 time: 0.031638 Sep 12 12:01:09.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 523/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:09 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:01:09.784467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:09.784960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:09.790950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.791440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.791903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.792593 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.793053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.793486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.829396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1826305846", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051257965", "security_groups": [{"name": "tempest-secgroup-smoke-604561767"}], "block_device_mapping_v2": [{"uuid": "ba397018-a7e0-402a-9f90-12e2233cd8f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7979205-0c82-4090-b1b7-10cd6c0b471c"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:09.875192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lazy-loading 'services' on Instance uuid e4186db1-608b-48ac-9c97-b6f35fa5bbc8 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:01:09.948613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-144eabb1-9c67-41f0-aa99-b099d0989c55 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments/3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a" status: 202 len: 0 microversion: 2.1 time: 0.167773 Sep 12 12:01:09.949137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 524/1045] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:01:09 2022] DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments/3fdc48f4-4c46-43c5-b9a3-e140ecb9cb6a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 12:01:09.950376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] validate_networks() for [('d7979205-0c82-4090-b1b7-10cd6c0b471c', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:01:09.958441 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:09.961112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:09.968635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.969038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.969566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.970292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:09.970841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:09.971273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:09.988010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:10.004071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a20802b9-7884-4014-a8a8-c07a8aa9a3af tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049912 Sep 12 12:01:10.004638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 525/1046] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:01:09 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:01:10.328337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:01:10.328761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:01:10.329235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:01:10.329641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:01:10.330052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:01:10.338748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:10.339228 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:10.339662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:10.340387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:10.340839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:10.341261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:10.357921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:01:10.361865 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for user fb4bb9cd41cd46ddb87a746e732a948f and project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:01:10.418377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:01:10.420524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba397018-a7e0-402a-9f90-12e2233cd8f5',volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:01:10.553607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f4f38f85-6650-486c-84a5-5bd28ad567e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.822907 Sep 12 12:01:10.554659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 522/1047] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:01:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 12:01:10.566120 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1e29821-8732-49b5-a2c8-091ca2bc5bc0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:10.566758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1e29821-8732-49b5-a2c8-091ca2bc5bc0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:10.622122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1e29821-8732-49b5-a2c8-091ca2bc5bc0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:10.630828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1e29821-8732-49b5-a2c8-091ca2bc5bc0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1095 microversion: 2.1 time: 0.068523 Sep 12 12:01:10.631476 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 526/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:10 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:11.017481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:11.019848 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:11.027134 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.027625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.028061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.028765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.029223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.029651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.059261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-654b00eb-02ed-4af6-8c48-45deabae019d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045836 Sep 12 12:01:11.059843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 523/1049] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:01:11 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:01:11.142697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:11.143197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:11.150467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.150988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.151430 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.152121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.152606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.153031 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.178724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:01:11.266528 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f21892e6-677a-4ba1-946e-4f83104bd180 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 204 len: 0 microversion: 2.1 time: 0.127428 Sep 12 12:01:11.267327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 527/1050] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:01:11 2022] DELETE /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:01:11.276107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:11.276720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:11.283108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.283680 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.284305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.285103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.285567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.285993 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.418919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:11.426698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b1b0515-672a-4ec5-b347-e4858115d5f6 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1691 microversion: 2.1 time: 0.154868 Sep 12 12:01:11.427270 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 524/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:11 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:11.655112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:11.655828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:11.662050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.662537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.662982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.663661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:11.664111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:11.664537 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:11.729351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:11.736920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f11dab27-d3dd-4d7f-ae2d-55667ccdff59 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1193 microversion: 2.1 time: 0.086333 Sep 12 12:01:11.737469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 528/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:11 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:12.449849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:12.450400 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:12.456733 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:12.457214 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:12.457654 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:12.458334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:12.458815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:12.459236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:12.589602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:12.597624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-358446b5-4080-4655-8679-c6df583fb57c tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1691 microversion: 2.1 time: 0.151745 Sep 12 12:01:12.598185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 525/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:12 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:12.759464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:12.759996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:12.766285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:12.766790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:12.767230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:12.767931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:12.768385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:12.768804 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:12.832216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:12.840310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e9ea7af-2b30-4cf8-9025-0582d6f97057 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1193 microversion: 2.1 time: 0.084871 Sep 12 12:01:12.840866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 529/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:12 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:13.621569 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:13.622204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:13.628686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:13.629159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:13.629588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:13.630260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:13.630740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:13.631161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:13.758757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:13.766348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f24eeea7-4bfc-406a-85b5-07f58f0477b2 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1691 microversion: 2.1 time: 0.148699 Sep 12 12:01:13.766947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 526/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:13 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:13.863370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:13.863986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:13.871404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:13.871943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:13.872336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:13.873027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:13.873484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:13.873932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:13.935156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:13.942545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a500417e-58a9-4678-a25e-213750c434f1 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1193 microversion: 2.1 time: 0.083065 Sep 12 12:01:13.943116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 530/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:13 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:14.789466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:14.790085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:14.796485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:14.796997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:14.797438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:14.798126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:14.798616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:14.799046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:14.926451 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:14.934375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b80ba0d9-6773-4530-aa8e-592994f1899d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1691 microversion: 2.1 time: 0.149072 Sep 12 12:01:14.934961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 527/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:14 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:14.965743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:14.966346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:14.972739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:14.973214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:14.973647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:14.974330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:14.974813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:14.975240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:15.035778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:15.043392 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-127e618d-4f75-4c68-a577-a66cefcb4544 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1193 microversion: 2.1 time: 0.081501 Sep 12 12:01:15.043944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 531/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:14 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:15.957231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:15.957981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:15.960896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:15.966403 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:15.967254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:15.967784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:15.968815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:15.969173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:15.969626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:16.067040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:16.067650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:16.082335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:16.083123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:16.083559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:16.086100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:16.086755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:16.087328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:16.112963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:16.122550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-52f676a1-db44-4a1d-b736-21e7faa024d9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1691 microversion: 2.1 time: 0.169227 Sep 12 12:01:16.124360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 528/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:15 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:16.180524 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:16.189156 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d204c2a0-2bd4-48a0-8339-1ed02f9f5874 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1211 microversion: 2.1 time: 0.126387 Sep 12 12:01:16.195221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 532/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:16 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:17.147067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:17.148551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:17.155114 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:17.155807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:17.156425 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:17.157314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:17.157928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:17.158717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:17.216905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:17.218896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:17.231897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:17.240106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4b80535b-02b2-494b-b542-e6818b212592 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1624 microversion: 2.1 time: 0.096856 Sep 12 12:01:17.242656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 529/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:17 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1624 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:17.265226 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:17.266138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:17.267094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:17.267996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:17.268650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:17.269440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:17.353234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4186db1-608b-48ac-9c97-b6f35fa5bbc8", "name": "network-vif-deleted", "tag": "8c2168dd-a2d3-418a-b514-e916004aa71b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:17.371410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:17.371906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:17.372343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:17.407150 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] Creating event network-vif-deleted:8c2168dd-a2d3-418a-b514-e916004aa71b for instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 on hv-cinder-85331 Sep 12 12:01:17.412951 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-71c5d66e-fcd1-4754-8f40-b3ad6da9a75d req-5c417d05-f38b-41a5-8974-b4d086c4a944 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063693 Sep 12 12:01:17.413930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 530/1062] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:01:17.579072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:17.588085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-381967b3-631a-4d9c-8b70-4511d80c773c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.378652 Sep 12 12:01:17.606353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 533/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:17 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:18.265631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:18.267025 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:18.280814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:18.281306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:18.281744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:18.282445 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:18.283019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:18.283673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:18.321725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:18.322637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:18.323096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:18.323662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lazy-loading 'fault' on Instance uuid e4186db1-608b-48ac-9c97-b6f35fa5bbc8 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:01:18.377883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:18.387065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea9533ac-f326-4274-a94a-9d3565f6c5b9 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 200 len: 1336 microversion: 2.1 time: 0.126079 Sep 12 12:01:18.387996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 531/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:18 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 1336 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:18.620682 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:18.621364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:18.628505 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:18.628998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:18.629440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:18.630162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:18.630639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:18.631071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:18.961097 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:18.968982 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4afe1019-f3ef-4096-83c2-58531fc6402e tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.358898 Sep 12 12:01:18.969814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 534/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:18 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:19.410736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:19.411344 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: e4186db1-608b-48ac-9c97-b6f35fa5bbc8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:19.417908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:19.418382 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:19.418897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:19.419577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:19.420026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:19.420448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:19.434074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] HTTP exception thrown: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Request method failure captured: Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 HTTP/1.1 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2pk6V14JcYQLujBB4-HkiOoGyStG7TOyLJKTe_ZIU4APyDWKn0SP86S_McGOg4GujcFNCzKDMuTD-HiIz___jSXF5z45qU319_0Tv4ibuaQpqMgO1ScLbkuiVXVMFtC2Xmid0u8fK0DnuxI6OeRKbjnvxdEOOZv9k_HBesY3QlyJM Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:01:19.435762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/92efab98bce54b08899f057951b42617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_92efab98bce54b08899f057951b42617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}] Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 66682d5656d3414eaebba666d4e0771f Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. Sep 12 12:01:19.437389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'e4186db1-608b-48ac-9c97-b6f35fa5bbc8'} Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:01:19.438280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. Sep 12 12:01:19.439972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:01:19.441378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Returning 404 to user: Instance e4186db1-608b-48ac-9c97-b6f35fa5bbc8 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:01:19.441378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-83fc21ae-0f81-42fa-991b-92f02a4ca4a3 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8" status: 404 len: 111 microversion: 2.1 time: 0.030342 Sep 12 12:01:19.441378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 532/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:19 2022] GET /compute/v2.1/servers/e4186db1-608b-48ac-9c97-b6f35fa5bbc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:01:19.442356 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a129c6-8c47-41e9-b784-2f88285ab563", "tag": "a3a43907-0264-42ae-8f33-3cec8732e84c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:19.446443 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5b8cd90c-42c6-45d5-8788-4e39bf14f02a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '.version_select at 0x7fc93a3d1310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:19.453511 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:19.453990 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:19.454424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:19.466041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5b8cd90c-42c6-45d5-8788-4e39bf14f02a tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019313028" status: 202 len: 0 microversion: 2.1 time: 0.024287 Sep 12 12:01:19.466556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] Creating event network-changed:a3a43907-0264-42ae-8f33-3cec8732e84c for instance 38a129c6-8c47-41e9-b784-2f88285ab563 on hv-cinder-85331 Sep 12 12:01:19.470722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 533/1067] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 12 12:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019313028 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:01:19.471590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-98657600-7c65-4b99-bb5d-fde3073d9cb3 req-7883baab-0773-48bc-8907-850ff76c92c5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033057 Sep 12 12:01:19.472474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 535/1068] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:19.992184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:19.992798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:19.998644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:19.999127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:19.999557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:20.000232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:20.000686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:20.001429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:20.135487 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:20.143541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1c7f5d87-715e-4ef8-a422-bc96eec2d290 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.155647 Sep 12 12:01:20.144106 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 534/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:19 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:21.165431 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:21.169653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:21.170530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:21.176921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:21.177403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:21.177842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:21.178556 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:21.179023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:21.179454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:21.315648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:21.323465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a4d69c7-77e6-41ba-86b6-090261289dd3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.160333 Sep 12 12:01:21.324033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 536/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:21 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:22.346731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:22.347341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:22.349292 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:22.349945 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:22.357484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.357960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.358393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.359107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.359557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.359977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.493775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:22.501286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-da2ae91a-9e51-45bd-944e-5dc551d7b921 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.158555 Sep 12 12:01:22.501852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 535/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:22 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:22.738842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:22.739338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:22.741854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:22.747082 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.747567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.748007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.748696 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.749153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.749581 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.774394 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:01:22.847635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d2fcd15-3e8a-4de8-91ab-775ddc79a9a1 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 204 len: 0 microversion: 2.1 time: 0.112205 Sep 12 12:01:22.848489 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 537/1072] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:01:22 2022] DELETE /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:01:22.859029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:22.859637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:22.865742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.866480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.866959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.867634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:22.868082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:22.868500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:22.995485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:23.003022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0787c2c1-55ef-4e12-bd47-27875f1db534 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1507 microversion: 2.1 time: 0.148367 Sep 12 12:01:23.003582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 536/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:22 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:23.525072 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:23.525767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:23.532541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:23.533389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:23.534147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:23.535411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:23.536205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:23.536963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:23.673714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:23.682147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d1824ba-a91f-417d-b0bd-2c74e42a27cd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.161460 Sep 12 12:01:23.682743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 538/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:23 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:24.027241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:24.027856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:24.034332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:24.034863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:24.035303 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:24.035991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:24.036450 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:24.036873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:24.170059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:24.177909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1a2f8ac0-5507-47a5-a9e5-f822d0df40ff tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 200 len: 1507 microversion: 2.1 time: 0.155226 Sep 12 12:01:24.190534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 537/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:24 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:24.388345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635b3409-f52c-4b47-85ed-dec792d0bd8d", "name": "network-vif-deleted", "tag": "e3afbefc-1ce9-4a84-b30a-e5117f9cfa67"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:24.404114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:24.404596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:24.405022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:24.416951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] Creating event network-vif-deleted:e3afbefc-1ce9-4a84-b30a-e5117f9cfa67 for instance 635b3409-f52c-4b47-85ed-dec792d0bd8d on hv-cinder-85331 Sep 12 12:01:24.422540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d2ec44c1-8099-4f5b-b1cc-a8d1e42d05fb req-bffa05c7-401c-43ef-9794-2bccd4bfc8a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037592 Sep 12 12:01:24.423213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 539/1076] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:24.706008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:24.706651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:24.713967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:24.714461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:24.714917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:24.715616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:24.716139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:24.716566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:24.736215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:24.855378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:24.863079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0648af40-6834-4097-b135-61dee419c5e3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.162438 Sep 12 12:01:24.863638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 538/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:24 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:25.201733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:25.202424 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 635b3409-f52c-4b47-85ed-dec792d0bd8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:25.208521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.208999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.209435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.210118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.211632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.212069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.225317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] HTTP exception thrown: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Request method failure captured: Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d HTTP/1.1 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2pk6V14JcYQLujBB4-HkiOoGyStG7TOyLJKTe_ZIU4APyDWKn0SP86S_McGOg4GujcFNCzKDMuTD-HiIz___jSXF5z45qU319_0Tv4ibuaQpqMgO1ScLbkuiVXVMFtC2Xmid0u8fK0DnuxI6OeRKbjnvxdEOOZv9k_HBesY3QlyJM Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:01:25.227115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/92efab98bce54b08899f057951b42617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_92efab98bce54b08899f057951b42617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}] Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 66682d5656d3414eaebba666d4e0771f Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. Sep 12 12:01:25.228700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '635b3409-f52c-4b47-85ed-dec792d0bd8d'} Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:01:25.229635 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. Sep 12 12:01:25.231165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:25.232541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Returning 404 to user: Instance 635b3409-f52c-4b47-85ed-dec792d0bd8d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:01:25.232541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea974ab0-3d5a-4d22-940e-f64ac0ed65d7 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d" status: 404 len: 111 microversion: 2.1 time: 0.031032 Sep 12 12:01:25.232541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 540/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:25 2022] GET /compute/v2.1/servers/635b3409-f52c-4b47-85ed-dec792d0bd8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:01:25.237064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:25.237599 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:25.244271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.244746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.245180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.245859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.246310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.246789 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.271212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:01:25.347896 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-46b9af9b-e2b6-4892-b221-a514b33d9c4d tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 204 len: 0 microversion: 2.1 time: 0.114394 Sep 12 12:01:25.348471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 539/1079] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:01:25 2022] DELETE /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:01:25.356999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:25.357615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:25.363446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.363936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.364589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.365286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.365767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.366216 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.496924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:25.500419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:01:25.505772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d83b2265-7be8-4dee-984a-e9d8f42b2e35 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.152641 Sep 12 12:01:25.506768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 541/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:25 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:01:25.886534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:25.887237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:25.893138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.893627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.894070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:25.894793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:25.895254 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:25.895685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:26.024947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:26.032733 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a8ecf945-2092-4bf5-8f9d-d60cf431d3b3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.151208 Sep 12 12:01:26.033313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 540/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:25 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:26.529901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:26.530507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:26.537439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:26.537920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:26.538359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:26.539087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:26.539539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:26.539970 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:26.668118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:26.675769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa2eba38-b155-44e2-be58-5140148e0ebc tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1522 microversion: 2.1 time: 0.150501 Sep 12 12:01:26.676334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 542/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:26 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:27.055615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:27.056534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:27.062887 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:27.063371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:27.063808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:27.064495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:27.064949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:27.065373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:27.200435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:27.208105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e511daaa-5dc0-4104-8f01-c24e248e205a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.157086 Sep 12 12:01:27.208669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 541/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:27 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:27.700459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:27.701341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:27.707770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:27.708267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:27.708809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:27.709521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:27.711234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:27.711881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:27.731041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4310e71e-de3e-4855-8800-8bb60f9d8428", "name": "network-vif-deleted", "tag": "902c7450-29c6-4c7a-8480-15a41b613dc5"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:27.740217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:27.740699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:27.741129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:27.752817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] Creating event network-vif-deleted:902c7450-29c6-4c7a-8480-15a41b613dc5 for instance 4310e71e-de3e-4855-8800-8bb60f9d8428 on hv-cinder-85331 Sep 12 12:01:27.757982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a2666733-0ae9-4648-8e95-4712bee55c10 req-9242cc8b-d7c4-44d0-84d1-6755890e5654 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 Sep 12 12:01:27.758603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 542/1084] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:01:27.783689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66682d5656d3414eaebba666d4e0771f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92efab98bce54b08899f057951b42617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:27.791498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8fb09f6-27ca-4207-8512-58a080a33fbf tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 200 len: 1480 microversion: 2.1 time: 0.095722 Sep 12 12:01:27.792071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 543/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:27 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 1480 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:28.231361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:28.232008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:28.238082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:28.238602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:28.239040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:28.239717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:28.240167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:28.240584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:28.379914 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:28.389395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f3fb72e-38c4-4987-9687-91d451713621 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.163326 Sep 12 12:01:28.389954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 543/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:28 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:28.816029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:28.816609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] [instance: 4310e71e-de3e-4855-8800-8bb60f9d8428] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:28.823701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:28.824178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:28.824609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:28.825291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:28.825739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:28.826168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:28.839085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] HTTP exception thrown: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Request method failure captured: Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 HTTP/1.1 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2pk6V14JcYQLujBB4-HkiOoGyStG7TOyLJKTe_ZIU4APyDWKn0SP86S_McGOg4GujcFNCzKDMuTD-HiIz___jSXF5z45qU319_0Tv4ibuaQpqMgO1ScLbkuiVXVMFtC2Xmid0u8fK0DnuxI6OeRKbjnvxdEOOZv9k_HBesY3QlyJM Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:01:28.840589 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/92efab98bce54b08899f057951b42617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_92efab98bce54b08899f057951b42617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/92efab98bce54b08899f057951b42617"}]}] Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 92efab98bce54b08899f057951b42617 Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175369428 Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 66682d5656d3414eaebba666d4e0771f Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175369428-project Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. Sep 12 12:01:28.842247 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '4310e71e-de3e-4855-8800-8bb60f9d8428'} Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:01:28.843220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. Sep 12 12:01:28.844678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:28.846024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] Returning 404 to user: Instance 4310e71e-de3e-4855-8800-8bb60f9d8428 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:01:28.846024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba2f44ac-9a76-4cea-bb94-87ec3b756299 tempest-ServerRescueNegativeTestJSON-175369428 tempest-ServerRescueNegativeTestJSON-175369428-project] 10.222.0.15 "GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428" status: 404 len: 111 microversion: 2.1 time: 0.029896 Sep 12 12:01:28.846024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 544/1087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:28 2022] GET /compute/v2.1/servers/4310e71e-de3e-4855-8800-8bb60f9d8428 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:01:29.412126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:29.412657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:29.419688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:29.420181 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:29.420623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:29.421318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:29.421773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:29.422199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:29.557180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:29.565045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed0833ca-d52b-4b89-9b2c-1d01d6e8c8ac tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.156812 Sep 12 12:01:29.565618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 544/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:29 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:30.488179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a129c6-8c47-41e9-b784-2f88285ab563", "name": "network-vif-plugged", "status": "completed", "tag": "a3a43907-0264-42ae-8f33-3cec8732e84c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:30.501948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:30.502923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:30.503527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:30.517762 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] Creating event network-vif-plugged:a3a43907-0264-42ae-8f33-3cec8732e84c for instance 38a129c6-8c47-41e9-b784-2f88285ab563 on hv-cinder-85331 Sep 12 12:01:30.524520 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2d8bcd95-7767-4588-b89a-19dbc518078c req-0e5d8fbf-17d8-4d60-a204-0b12c4b55d2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039916 Sep 12 12:01:30.525662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 545/1089] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:30.588626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:30.589269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:30.596088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:30.596590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:30.597032 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:30.597831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:30.598291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:30.598752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:30.751061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:30.761594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a13bcaf9-d3b0-4847-a7ef-494236779afe tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.177338 Sep 12 12:01:30.777798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 545/1090] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:30 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:31.787763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:31.788558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:31.795344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:31.795900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:31.796517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:31.797407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:31.798042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:31.798671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:32.009771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:32.017795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5840169f-515e-4d07-a049-d429134aba35 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1266 microversion: 2.1 time: 0.234271 Sep 12 12:01:32.018623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 546/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:31 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:33.041010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:33.041528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:33.048200 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:33.048675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:33.049115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:33.050265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:33.051103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:33.051858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:33.219341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:33.228907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-803702de-ce25-451c-9143-df06a757a4e0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1452 microversion: 2.1 time: 0.190900 Sep 12 12:01:33.230180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 546/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:33 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:33.255944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:33.256691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:01:33.264048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:33.264607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:33.265404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:33.266267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:33.266897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:33.267473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:33.409620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:01:33.417521 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c503b3ff-4aaa-4bfe-a826-88fe32baa429 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1452 microversion: 2.1 time: 0.165830 Sep 12 12:01:33.418096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 547/1093] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:01:33 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:01:33.750882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aebddc34-663a-41d0-98a2-946cc868a02e tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Action: 'create', calling method: .version_select at 0x7fc93a3bac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1046869881", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:34.061437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aebddc34-663a-41d0-98a2-946cc868a02e tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.449202 Sep 12 12:01:34.062581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 547/1094] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 12 12:01:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 12:01:34.075996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ea292f1-d652-4a69-b35c-293a0c38c746 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a3a0b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:34.136227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ea292f1-d652-4a69-b35c-293a0c38c746 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 200 len: 353 microversion: 2.1 time: 0.063959 Sep 12 12:01:34.136797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 548/1095] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:01:34 2022] GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:35.044105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a129c6-8c47-41e9-b784-2f88285ab563", "tag": "a3a43907-0264-42ae-8f33-3cec8732e84c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:01:35.054864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:01:35.055693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:01:35.056191 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:01:35.066619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] Creating event network-changed:a3a43907-0264-42ae-8f33-3cec8732e84c for instance 38a129c6-8c47-41e9-b784-2f88285ab563 on hv-cinder-85331 Sep 12 12:01:35.072221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-35ec9061-8a86-44a1-a30e-821ed92cc277 req-5314c480-c123-46d0-ad60-26c0d5ac55ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031725 Sep 12 12:01:35.072912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 548/1096] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:35.153138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84e5a9a2-4458-423a-b108-146cc96d473f tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a22ed30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:35.209364 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84e5a9a2-4458-423a-b108-146cc96d473f tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 200 len: 354 microversion: 2.1 time: 0.062115 Sep 12 12:01:35.210376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 549/1097] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:01:35 2022] GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:35.223963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1fc99ed2-54ed-4d43-8013-efbae1c7a99e tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a2d6280>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:35.275392 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1fc99ed2-54ed-4d43-8013-efbae1c7a99e tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 200 len: 354 microversion: 2.1 time: 0.055676 Sep 12 12:01:35.277041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 549/1098] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:01:35 2022] GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:01:35.296898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6074652-589c-465c-b0c7-4181c7435de8 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a34c310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:35.364257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6074652-589c-465c-b0c7-4181c7435de8 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 202 len: 0 microversion: 2.1 time: 0.071067 Sep 12 12:01:35.364844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 550/1099] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:01:35 2022] DELETE /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:01:35.374223 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3a4f28b3-d4b9-4a92-b60c-2ac1cb55a1cc tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a2a1430>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:35.434456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3a4f28b3-d4b9-4a92-b60c-2ac1cb55a1cc tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 200 len: 353 microversion: 2.1 time: 0.064570 Sep 12 12:01:35.435118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 550/1100] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:01:35 2022] GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:01:36.449808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7fee080-25dc-434c-a75d-c634d628b605 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Calling method '.version_select at 0x7fc93a3a0dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:01:36.477575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c7fee080-25dc-434c-a75d-c634d628b605 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] HTTP exception thrown: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7fee080-25dc-434c-a75d-c634d628b605 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Request method failure captured: Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 HTTP/1.1 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx-d36HtsOqxooDvCJiExyk04ZCG_vE6k14PSpR_xtDzllhR_MNh9ub4bGzX6_Ua8HxgpHgPeH1dYpIaBC7NZSpCHQ2Ze3HonnIAXLCqozVldpDLodrUSMrJXB9IOsRxzofBrEVbvM6HJAjIBlKvWb3nxuA8hu_ybkPMdwyzjyE_uz8 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: e2f949fe717f488c8ff3ce5ac3145fe2 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesGetTestJSON-372408128 Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:01:36.479643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2f949fe717f488c8ff3ce5ac3145fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2f949fe717f488c8ff3ce5ac3145fe2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2f949fe717f488c8ff3ce5ac3145fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2f949fe717f488c8ff3ce5ac3145fe2"}]}] Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesGetTestJSON-372408128 Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: e2f949fe717f488c8ff3ce5ac3145fe2 Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesGetTestJSON-372408128 Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesGetTestJSON-372408128-project Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 83c4ec497c1f41619f6da313ebbc25e3 Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesGetTestJSON-372408128-project Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'e8d2ef5a-9597-4494-a5b3-93eb7ff47f38'} Sep 12 12:01:36.481172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. (HTTP 404) (Request-ID: req-c161317b-ac62-4ded-ae7a-1031e3bb0b04) Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:36.482220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 12:01:36.483694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 12:01:36.485332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7fee080-25dc-434c-a75d-c634d628b605 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] Returning 404 to user: Volume e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7fee080-25dc-434c-a75d-c634d628b605 tempest-VolumesGetTestJSON-372408128 tempest-VolumesGetTestJSON-372408128-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38" status: 404 len: 109 microversion: 2.1 time: 0.035568 Sep 12 12:01:36.486784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 551/1101] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:01:36 2022] GET /compute/v2.1/os-volumes/e8d2ef5a-9597-4494-a5b3-93eb7ff47f38 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:02:10.961820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:10.962905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:11.148613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-40cc4caf-b7d2-4349-826b-96b5fe8f8a83 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Action: 'create', calling method: .version_select at 0x7fc93a2360d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1208696406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITUcWsRk2OEtAAUDhYFs8WwGoggOBMVWl7C7R/LQDMVFkA/o4vkWaD5dVFh0BAPmzxyw6dnpkYym+599OBfdLCHHQJMpRPqdlhlI0Uwt5ae6y+t50YtohxxuOQPF4EYsQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:11.165158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-40cc4caf-b7d2-4349-826b-96b5fe8f8a83 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Getting quotas for project 2862c2760b6548ae95e2ce59470ede1d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:11.168951 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-40cc4caf-b7d2-4349-826b-96b5fe8f8a83 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Getting quotas for user 72ff513b1b924f54818d7d3e38eb4a0b and project 2862c2760b6548ae95e2ce59470ede1d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:11.193020 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-40cc4caf-b7d2-4349-826b-96b5fe8f8a83 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.233181 Sep 12 12:02:11.193629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 551/1102] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 12:02:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:15.937497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:15.938678 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:15.946412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:15.948715 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:15.956781 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:15.957499 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:15.958009 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:15.958799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:15.959266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:15.959721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:15.989811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd9796b1-69df-4a70-bf68-82b2a5a8801d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054643 Sep 12 12:02:15.990357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 552/1103] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:02:15 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:02:16.055807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:16.056411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:16.062670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:16.063147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:16.063576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:16.064252 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:16.064796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:16.065227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:16.093117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:02:16.169145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a26e4aa5-eb78-4ad6-951f-5a91ce32949b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 204 len: 0 microversion: 2.1 time: 0.118036 Sep 12 12:02:16.169764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 552/1104] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:02:16 2022] DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:02:16.179315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:16.180089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:16.186419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:16.186951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:16.187401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:16.188147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:16.188606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:16.189038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:16.324158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:16.339186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34da25c7-8e1b-4ff3-b16d-2ce122b6fbc7 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1673 microversion: 2.1 time: 0.164686 Sep 12 12:02:16.339772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 553/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:16 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:17.364155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:17.364870 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:17.371339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:17.371830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:17.372272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:17.372968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:17.373426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:17.374044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:17.508297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:17.516061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-64a1928e-fb2f-4919-acb8-afcac10b5e8e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1673 microversion: 2.1 time: 0.156701 Sep 12 12:02:17.516624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 553/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:17 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:18.541944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:18.542927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:18.550205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:18.550947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:18.551631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:18.552349 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:18.552844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:18.553468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:18.803354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:18.811529 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6f0cc75-ddae-4f45-ad74-fef32531219a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1673 microversion: 2.1 time: 0.273973 Sep 12 12:02:18.812112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 554/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:18 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:19.515243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bff9ca9-92fa-4ad9-867f-4f889d1261bc", "name": "network-vif-deleted", "tag": "1f7a6854-4f86-4255-8146-a2403a0437ef"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:19.525524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:19.526105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:19.526585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:19.539627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] Creating event network-vif-deleted:1f7a6854-4f86-4255-8146-a2403a0437ef for instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc on hv-cinder-85331 Sep 12 12:02:19.545518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-812e391c-a341-40ec-b74b-ca511f17601b req-cf0c03e6-2085-441b-8cc8-8da7a2f3535d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033965 Sep 12 12:02:19.546486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 554/1108] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:19.838080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:19.839409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:19.848405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:19.849132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:19.849579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:19.850351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:19.850853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:19.851289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:19.884198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:19.884689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:19.885135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:19.885591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lazy-loading 'fault' on Instance uuid 7bff9ca9-92fa-4ad9-867f-4f889d1261bc {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:02:19.931877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:19.939765 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b10626b4-3475-4b18-bc86-3402d82604f4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 200 len: 1326 microversion: 2.1 time: 0.105777 Sep 12 12:02:19.940455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 555/1109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:19 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:20.963906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:20.964833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:20.971081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:20.971557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:20.972474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:20.973164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:20.973617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:20.974048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:20.987352 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc HTTP/1.1 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:02:20.989832 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:02:20.991627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '7bff9ca9-92fa-4ad9-867f-4f889d1261bc'} Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:02:20.992639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:02:20.994232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:20.995705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:02:20.995705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4832bb88-2b5b-4a57-8155-57f20b9aa9ca tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 404 len: 111 microversion: 2.1 time: 0.032136 Sep 12 12:02:20.995705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 555/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:20 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:02:21.000580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30c28b27-0874-4d77-acdf-ee40b6588608 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '.version_select at 0x7fc93a34c5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:21.020916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30c28b27-0874-4d77-acdf-ee40b6588608 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-30101850" status: 202 len: 0 microversion: 2.1 time: 0.024343 Sep 12 12:02:21.021498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 556/1111] 10.222.0.15 () {58 vars in 1215 bytes} [Mon Sep 12 12:02:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-30101850 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 12:02:21.682413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-33e7aad9-3352-4431-bc50-a46f31d300bc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: .version_select at 0x7fc93a3be430>, body: {"keypair": {"name": "tempest-keypair-964907371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaBS6ji8KiDJTqvwa0RgfevqESr8qkETQy2HeQoz+Oqx15RGRmmsdKPZgPInKKxT69FOh9ObIlaGe0+DJb1E2kCw10L9wYtmOZvIkVIV7RHgeFnZlCyHikz8W75LVmw5A=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:21.687779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:21.699698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-33e7aad9-3352-4431-bc50-a46f31d300bc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:21.703837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-33e7aad9-3352-4431-bc50-a46f31d300bc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for user 16e5bc69062549e5bebb5b33e1be492e and project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:21.727412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-33e7aad9-3352-4431-bc50-a46f31d300bc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049088 Sep 12 12:02:21.728013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 556/1112] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 12:02:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:23.012407 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-822296735", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8119da17-2877-4086-aa22-ceb6305c044c"}], "security_groups": [{"name": "tempest-securitygroup--1635455952"}], "key_name": "tempest-keypair-964907371", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:23.114572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] validate_networks() for [('8119da17-2877-4086-aa22-ceb6305c044c', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:02:23.480242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:02:23.480665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:02:23.481136 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:02:23.481543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:02:23.481952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:02:23.490832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:23.491341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:23.491780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:23.492504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:23.492960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:23.493405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:23.509620 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:23.513548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Getting quotas for user 16e5bc69062549e5bebb5b33e1be492e and project 6e8a7ef82545435fa36586761e3c85c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:23.525984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:02:23.528310 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:02:23.577414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0c773b3-1c1b-4078-91df-2c963b1ff15a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569792 Sep 12 12:02:23.578060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 557/1113] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:02:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 12:02:23.590045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c5cc782c-8249-4236-8fea-1ae7e5384273 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:23.590693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c5cc782c-8249-4236-8fea-1ae7e5384273 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:23.648573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c5cc782c-8249-4236-8fea-1ae7e5384273 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:23.655534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c5cc782c-8249-4236-8fea-1ae7e5384273 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1236 microversion: 2.1 time: 0.069790 Sep 12 12:02:23.656419 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 557/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:23 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:24.679795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:24.680413 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:24.687425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:24.687919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:24.688361 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:24.689093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:24.689597 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:24.690242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:24.771788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:24.779967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3febe704-8994-4e32-b767-db929b048e16 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1296 microversion: 2.1 time: 0.105304 Sep 12 12:02:24.780825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 558/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:24 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:25.805631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:25.806299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:25.814116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:25.814644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:25.815094 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:25.815815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:25.816810 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:25.817555 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:25.958277 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:25.966380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-26577f44-9aaf-421f-b019-dd0b57a6b7c1 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.166095 Sep 12 12:02:25.966998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 558/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:25 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:26.542387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6165a80-b710-4577-ba2b-f6e17e375702", "tag": "8171c3fb-1ad0-440a-99c4-49bd90110272"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:26.554277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:26.554802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:26.555266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:26.567165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] Creating event network-changed:8171c3fb-1ad0-440a-99c4-49bd90110272 for instance e6165a80-b710-4577-ba2b-f6e17e375702 on hv-cinder-85331 Sep 12 12:02:26.572105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-52dccbe5-b7cb-4dad-a524-8de49392b4f7 req-85c62402-ebc3-47fc-bb45-2841637a2083 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034733 Sep 12 12:02:26.572897 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 559/1117] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:26.605955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:26.606470 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:26.612705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:26.613714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:26.614442 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:26.615257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:26.615715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:26.616142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:26.643051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-41a8021a-36cb-4adc-bdff-1ee557d2fc90 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/ips" status: 200 len: 152 microversion: 2.20 time: 0.040945 Sep 12 12:02:26.643746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 559/1118] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Sep 12 12:02:26 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 12:02:26.990818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:26.991519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:26.997574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:26.998057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:26.998528 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:26.999202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:26.999656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:27.000084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:27.131647 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:27.139283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-252e4e38-0848-4680-ad60-ccf80adb440d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.153679 Sep 12 12:02:27.139838 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 560/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:26 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:28.161220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:28.161922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:28.168441 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:28.168924 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:28.169361 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:28.170048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:28.170505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:28.170954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:28.300070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:28.308883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7a99f3ed-772c-48b9-a356-41e6d04b2544 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.151415 Sep 12 12:02:28.309492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 560/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:28 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:28.654043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:28.654638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:28.661464 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:28.661943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:28.662379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:28.663099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:28.663550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:28.663973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:28.686969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c83516b9-2b28-4c2c-94a8-b425bbc4e7b8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/ips" status: 200 len: 149 microversion: 2.1 time: 0.036842 Sep 12 12:02:28.687518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 561/1121] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:02:28 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:29.332662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:29.333206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:29.339644 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.340120 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.340554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.341235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.341690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.342113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.472798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:29.480730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e045299f-84df-412d-b857-ee2fc4eed2fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.152715 Sep 12 12:02:29.481299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 561/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:29 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:29.577705 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:29.578231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:29.584761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.585213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.585604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.586289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.586773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.587203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.610287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lazy-loading 'flavor' on Instance uuid 873cc9f8-eafa-40df-8e7e-34277921befb {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:02:29.796467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ed6cc4e-287d-41e7-a9f3-86f81c2d5b8c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/action" status: 202 len: 0 microversion: 2.20 time: 0.222494 Sep 12 12:02:29.797053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 562/1123] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 12 12:02:29 2022] POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:02:29.805510 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:29.806119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:29.812119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.812597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.813030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.813710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:29.814165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:29.814623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:29.939240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:29.947260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:29.948688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:29.949904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6d066466-3c4c-408c-935a-bb0c3b02a52f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.148640 Sep 12 12:02:29.950456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 562/1124] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:29 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:30.505052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:30.506720 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:30.513919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:30.514402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:30.514865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:30.515558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:30.516013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:30.516445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 12 12:02:30.553788 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR sqlalchemy.pool.impl.QueuePool Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Exception ignored in: . at 0x7fc93a732c10> Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Traceback (most recent call last): Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: connection_record.checkin() Sep 12 12:02:30.555403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 12 12:02:30.556992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: pool.dispatch.checkin(connection, self) Sep 12 12:02:30.556992 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 12 12:02:30.561508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: fn(*args, **kw) Sep 12 12:02:30.561700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 12 12:02:30.568488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: time.sleep(0) Sep 12 12:02:30.568638 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 12 12:02:30.569018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 12 12:02:30.569018 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: AssertionError: do not call blocking functions from the mainloop Sep 12 12:02:30.705239 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:30.713242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b95ece05-ca38-48ef-b0ef-1b4acce8b404 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.212648 Sep 12 12:02:30.713809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 563/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:30 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:30.976852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:30.977462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:30.983625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:30.984100 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:30.984532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:30.985208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:30.985656 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:30.986075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:31.078685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13c22928-5cf0-4a96-b4d6-ddbefefafdb6"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:31.081068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:31.088225 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:31.088718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:31.089294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:31.089880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:31.090298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:31.090939 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:31.120924 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:31.129160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:31.130706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:31.131860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e565f82c-f61b-426b-84fa-4d613ec4714c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.159803 Sep 12 12:02:31.132600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 563/1126] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:30 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:31.736161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:31.736777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:31.743290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:31.743770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:31.744215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:31.744904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:31.745357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:31.745783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:31.890505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:31.900642 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dff22d39-5359-4b46-b676-d72d7b4966c6 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.168320 Sep 12 12:02:31.901220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 564/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:31 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:32.157328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:32.158163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:32.165401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:32.165952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:32.166461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:32.167261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:32.167876 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:32.168307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:32.171819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4037d688-9c50-4445-8e49-e1b49381edb6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.097018 Sep 12 12:02:32.173592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 564/1128] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:02:31 2022] POST /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments => generated 194 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:32.316756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:32.325633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:32.327312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:32.328485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f1bd7bcc-6ffb-4b9e-b4ae-4a6801222698 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.175189 Sep 12 12:02:32.329043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 565/1129] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:32 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:02:32.924404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:32.925104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:32.932372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:32.932858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:32.933299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:32.933988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:32.934447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:32.934907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:33.063555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:33.071121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-385edfdd-a541-4157-aa7b-e86bfe33134d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.151402 Sep 12 12:02:33.071686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 565/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:32 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:33.355339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:33.355956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:33.362637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:33.363127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:33.363564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:33.364520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:33.364983 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:33.365415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:33.500290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:33.508426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:33.509901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:33.511104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57f129e7-9590-47f7-8ee3-6a9367a3f43b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.159785 Sep 12 12:02:33.511672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 566/1131] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:33 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:34.094257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:34.094916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:34.097299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:34.098087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:34.104174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:34.104717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:34.105166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:34.105864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:34.106329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:34.106790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:34.238787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:34.246839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cde429c0-fd58-462c-a7a5-454173cb0982 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.156406 Sep 12 12:02:34.247443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 566/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:34 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:34.537565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:34.538570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:34.540414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:34.547332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:34.547824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:34.548267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:34.548959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:34.549417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:34.549847 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:34.687072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:34.696608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:34.698059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:34.699263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f681c0e-aa53-4c45-893c-bc2f33e9ca76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.165973 Sep 12 12:02:34.699830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 567/1133] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:34 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:34.797205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6165a80-b710-4577-ba2b-f6e17e375702", "name": "network-vif-plugged", "status": "completed", "tag": "8171c3fb-1ad0-440a-99c4-49bd90110272"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:34.808947 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:34.809438 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:34.809876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:34.821916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] Creating event network-vif-plugged:8171c3fb-1ad0-440a-99c4-49bd90110272 for instance e6165a80-b710-4577-ba2b-f6e17e375702 on hv-cinder-85331 Sep 12 12:02:34.826703 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b445c394-ab27-475d-b1a2-fdc81ed04889 req-537c3636-cde4-4b3b-b5b1-5f1ea0a56fc7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033591 Sep 12 12:02:34.827328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 567/1134] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:35.269180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:35.269785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:35.276640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:35.277121 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:35.277553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:35.278233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:35.278713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:35.279129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:35.418830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:35.426335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-98aed38d-1699-4195-8bb4-833ddf52f684 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.161029 Sep 12 12:02:35.429934 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 568/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:35 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:35.726154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:35.727040 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:35.733361 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:35.733851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:35.734295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:35.735044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:35.735502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:35.735935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:35.740684 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:35.872324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:35.880345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:35.881780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:35.882956 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1138b39e-1d00-4054-a7a8-d0eadcd00e44 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.162050 Sep 12 12:02:35.883501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 568/1136] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:35 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:36.453216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:36.453829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:36.460323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:36.460799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:36.461233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:36.461913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:36.462367 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:36.462820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:36.591156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:36.598733 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f59d8577-67b2-4c23-a352-b89cef3cf93b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1362 microversion: 2.1 time: 0.149487 Sep 12 12:02:36.599404 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 569/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:36 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:36.909331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:36.909942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:36.917132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:36.917611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:36.918099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:36.918812 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:36.919272 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:36.919696 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.008566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-545407054", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1208696406", "security_groups": [{"name": "tempest-secgroup-smoke-958072971"}], "networks": [{"uuid": "843a6848-cfc9-49e6-9cd4-0b7e62f2b2be"}], "block_device_mapping_v2": [{"uuid": "40078b7a-01ca-4385-9d4a-8777d5ecc947", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:37.058269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:37.066316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:37.068312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:37.069490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11d6e387-fdde-4d48-bab8-11ae703039b5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.164200 Sep 12 12:02:37.070045 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 569/1138] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:36 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:37.123039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] validate_networks() for [('843a6848-cfc9-49e6-9cd4-0b7e62f2b2be', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:02:37.621532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:37.622144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:37.628600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.629084 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.630034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.630867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.631327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.631757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.748384 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:02:37.748871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:02:37.749199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:02:37.749603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:02:37.750012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:02:37.759526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.759664 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:37.760005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.760435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.761163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.761791 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.762218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.767033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbe15fec-a4e1-4bc9-836a-de7a89f0935d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1549 microversion: 2.1 time: 0.149406 Sep 12 12:02:37.767602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 570/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:37 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:37.779556 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Getting quotas for project 2862c2760b6548ae95e2ce59470ede1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:37.783455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Getting quotas for user 72ff513b1b924f54818d7d3e38eb4a0b and project 2862c2760b6548ae95e2ce59470ede1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:37.790050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:37.790580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:37.796484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.797032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.797536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.798283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:37.798856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:37.799347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:37.843209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:02:37.845341 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40078b7a-01ca-4385-9d4a-8777d5ecc947',volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:02:37.878984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71f10710-67a7-4a80-8e4d-6e66c724182c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092984 Sep 12 12:02:37.879607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 571/1140] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 12:02:37 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:37.980117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fbc178a8-a39e-4e3e-bead-8c65750e6c6b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975554 Sep 12 12:02:37.980785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 570/1141] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:02:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 12:02:37.992652 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e137374-ded3-497b-a2e3-dee2f61d45b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:37.993420 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e137374-ded3-497b-a2e3-dee2f61d45b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:38.065437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e137374-ded3-497b-a2e3-dee2f61d45b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:38.072606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e137374-ded3-497b-a2e3-dee2f61d45b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1088 microversion: 2.1 time: 0.084499 Sep 12 12:02:38.073176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 572/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:37 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:38.096196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:38.096871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:38.103602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:38.104075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:38.104514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:38.105213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:38.105667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:38.106262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:38.111508 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:38.263521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:38.272546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:38.273969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:38.275241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9625270c-1654-4350-b940-ff50cb40155f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.182956 Sep 12 12:02:38.275800 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 571/1143] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:38 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:38.874847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6165a80-b710-4577-ba2b-f6e17e375702", "tag": "8171c3fb-1ad0-440a-99c4-49bd90110272"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:38.885676 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:38.886155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:38.886611 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:38.897090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] Creating event network-changed:8171c3fb-1ad0-440a-99c4-49bd90110272 for instance e6165a80-b710-4577-ba2b-f6e17e375702 on hv-cinder-85331 Sep 12 12:02:38.901931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e25410aa-d57f-4566-8572-52e4e5967159 req-e9a3b4e8-d21f-4c12-ab55-f58316010599 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030776 Sep 12 12:02:38.902541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 573/1144] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:39.103235 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:39.104595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:39.114935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.115831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.116436 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.117318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.117935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.118366 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.187023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:39.198466 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-91610525-2e25-4285-b698-605b0bd99ad3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1130 microversion: 2.1 time: 0.102325 Sep 12 12:02:39.199568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 572/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:39 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1130 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:39.304628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:39.306163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:39.315070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.319087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.320008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.320989 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.321702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.322219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.518857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:39.532560 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:39.534922 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:39.536885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c736adc-5fc7-49dd-999a-45eda2c35066 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.237451 Sep 12 12:02:39.538384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 574/1146] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:39 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:39.745613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13c22928-5cf0-4a96-b4d6-ddbefefafdb6"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:39.748142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:39.754340 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.755002 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.755505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.756258 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.756792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.757278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.848055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments HTTP/1.1 Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 74 Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:02:39.850374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {"volumeAttachment": {"volumeId": "13c22928-5cf0-4a96-b4d6-ddbefefafdb6"}} Sep 12 12:02:39.852081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'server_id': 'f66e13ac-f5d7-4903-afbd-8a6059142cec', 'body': {'volumeAttachment': {'volumeId': '13c22928-5cf0-4a96-b4d6-ddbefefafdb6'}}} Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:39.853023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:39.854554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 400 to user: Invalid volume: volume 13c22928-5cf0-4a96-b4d6-ddbefefafdb6 is already attached to instances: f66e13ac-f5d7-4903-afbd-8a6059142cec {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e4405c0d-a6f1-4f44-b71b-f4d09edf356b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111029 Sep 12 12:02:39.856016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 573/1147] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:02:39 2022] POST /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:02:39.943468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:39.944064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:39.950353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.951155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.951815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:39.952729 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:39.953384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:39.954007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.051595 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'services' on Instance uuid f66e13ac-f5d7-4903-afbd-8a6059142cec {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:02:40.134276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b45c0426-2b57-427b-b607-a62c61f390f3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments/13c22928-5cf0-4a96-b4d6-ddbefefafdb6" status: 202 len: 0 microversion: 2.1 time: 0.195888 Sep 12 12:02:40.135028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 575/1148] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:02:39 2022] DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments/13c22928-5cf0-4a96-b4d6-ddbefefafdb6 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:02:40.143752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:40.147124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:40.153603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.154079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.154531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.155287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.155738 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.156194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.193575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-88fa5d03-fefa-4fed-942f-295be0088026 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053861 Sep 12 12:02:40.194142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 574/1149] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:02:40 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:40.224569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:40.225542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:40.232666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.233354 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.233792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.234773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.235303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.235806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.333177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:40.341013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28855164-391d-4172-abdf-5233260bc5e6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1204 microversion: 2.1 time: 0.121723 Sep 12 12:02:40.341587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 576/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:40 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:40.563779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:40.564447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:40.570582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.571068 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.571820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.573202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:40.573202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:40.573659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:40.713202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:40.725827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:40.727301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:40.728658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3d27a621-d923-4566-a118-63998739de1f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.168715 Sep 12 12:02:40.729310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 575/1151] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:40 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:41.206720 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:41.209030 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:41.215299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.215785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.216221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:41.216911 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.217362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.217786 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:41.252569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfd64851-58ce-46d0-9c41-c953146e9b05 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049694 Sep 12 12:02:41.253371 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 577/1152] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:02:41 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:41.364993 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:41.366343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:41.369862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:41.373388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.373875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.374311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:41.375064 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.375511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.375935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:41.525490 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:41.533082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4c377701-3c5f-4d3e-b0be-569c582991aa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.172618 Sep 12 12:02:41.533647 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 576/1153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:41 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:41.755949 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:41.756561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:41.765386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.765875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.766572 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:41.767389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:41.767853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:41.768288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.020342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:42.029024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:42.030453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:42.031639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c66d359f-d8a5-439a-8f2e-79b3d3ce244f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.280149 Sep 12 12:02:42.032233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 578/1154] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:41 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:42.216019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:42.227370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.227370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.228073 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.240067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] Creating event network-changed:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:02:42.244961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-5d3c69ef-7b6b-4674-85b2-bd173a4e6121 req-26cb4948-1681-4422-8513-9774a83d3403 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Sep 12 12:02:42.245942 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 577/1155] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:42.265501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:42.267979 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:42.274176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.274730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.275173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.275876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.276336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.276769 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.311400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b860f5ac-c734-4f45-bd44-01e27b304142 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049813 Sep 12 12:02:42.312282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 579/1156] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:02:42 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:02:42.380053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:42.380640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:42.387378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.387869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.388309 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.389031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.389727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.390156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.417511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:02:42.494702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0e94db4-075a-4f8e-82e9-a82ec35c97b3 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 204 len: 0 microversion: 2.1 time: 0.119553 Sep 12 12:02:42.495079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 578/1157] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:02:42 2022] DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 12:02:42.503617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:42.504942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:42.511644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.512138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.512577 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.513287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.513963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.520393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.558863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:42.559568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:42.565431 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.566098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.566542 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.567998 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:42.568449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:42.568869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:42.663736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:42.671385 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d83ca5f-3abf-4f31-9395-b356f0c615bf tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1681 microversion: 2.1 time: 0.171655 Sep 12 12:02:42.671963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 580/1158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:42 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:42.706533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:42.714297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc652798-6682-49ac-b8c2-d7a63489696f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.161277 Sep 12 12:02:42.714882 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 579/1159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:42 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:43.057299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:43.057903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:43.064343 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.064826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.065261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.065950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.066401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.067234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.197116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:43.205150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:43.206615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:43.208308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1d5e115a-7799-4e86-9238-4a4a184b70ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.154941 Sep 12 12:02:43.208874 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 581/1160] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:43 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:43.696152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:43.696764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:43.703116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.703592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.704022 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.704697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.705145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.705563 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.737215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:43.737827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:43.743743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.744229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.744665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.745353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:43.745807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:43.746234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:43.839154 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:43.847139 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9dff6d83-a659-4874-86a1-81f4dc23620e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1681 microversion: 2.1 time: 0.154952 Sep 12 12:02:43.847520 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 580/1161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:43 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:43.884155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:43.891758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4b7a2a6-25eb-4207-9c26-9b2c5325b948 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.158434 Sep 12 12:02:43.892316 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 582/1162] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:43 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:44.233681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:44.234291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:44.240874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.241350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.241784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:44.242464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.242977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.243399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:44.371566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:44.380083 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:44.381672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:44.382864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12b2ca0d-01f6-4ab0-a6bb-573d8adb4779 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.153187 Sep 12 12:02:44.383417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 581/1163] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:44 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:44.870534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:44.871143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:44.877776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.878253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.878725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:44.880037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.880527 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.880951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:44.914452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:44.915088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:44.921491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.921968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.922399 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:44.923108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:44.923559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:44.923980 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:45.019618 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:45.027411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-beb0e497-3e82-4541-a76a-7a01cc9994ba tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1681 microversion: 2.1 time: 0.160773 Sep 12 12:02:45.028292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 583/1164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:44 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:45.063140 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:45.070987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-947bcf0b-b958-4f47-83a7-55333f09223e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.160189 Sep 12 12:02:45.071548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 582/1165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:44 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:45.408513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:45.409147 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:45.416188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:45.416701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:45.417144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:45.417832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:45.418290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:45.418759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:45.546223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:45.554454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:45.555903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:45.557049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23b51058-ab01-436a-8475-3660a26290e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.152645 Sep 12 12:02:45.557607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 584/1166] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:45 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:46.051655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:46.052263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:46.059023 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.059509 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.059946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.060667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.061126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.061550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.093057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:46.093656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:46.096077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:46.102075 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.102588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.103051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.103753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.104231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.104686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.196573 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:46.204202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-343ae1fe-6342-414f-b3aa-fb7dd0e92b67 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1681 microversion: 2.1 time: 0.157060 Sep 12 12:02:46.204771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 583/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:46 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:46.241068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:46.248612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29666fe0-0af5-4c30-bd18-a41e7934bf4f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.159346 Sep 12 12:02:46.249168 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 585/1168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:46 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:46.581447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:46.582622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:46.588574 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.589059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.589497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.590183 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:46.590666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:46.591095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:46.728197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:46.736414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:46.737866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:46.739913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fd212b1a-ce81-4d12-9f6a-a9e9f52b1902 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.162348 Sep 12 12:02:46.740489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 584/1169] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:46 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:47.229931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:47.230594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:47.237148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.237626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.238085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.238950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.239409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.239835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.243807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:47.273460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:47.274804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:47.281461 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.281947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.282388 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.283136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.283591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.284278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.344574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:47.357716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52950c5d-16e4-479c-8359-847e18292eda tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1613 microversion: 2.1 time: 0.130995 Sep 12 12:02:47.357716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 586/1170] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:47 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:47.435515 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:47.443630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-463c75bc-eb8a-450a-b6ec-f780123705b7 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.176146 Sep 12 12:02:47.444534 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 585/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:47 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:47.654365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66e13ac-f5d7-4903-afbd-8a6059142cec", "name": "network-vif-deleted", "tag": "1402bb0d-8139-4b30-90be-b71437aa2652"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:47.666576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.667052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.667477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.680774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] Creating event network-vif-deleted:1402bb0d-8139-4b30-90be-b71437aa2652 for instance f66e13ac-f5d7-4903-afbd-8a6059142cec on hv-cinder-85331 Sep 12 12:02:47.686452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-86f957f9-6f58-402d-8ec8-14c3586be198 req-e44249f9-6e77-4ad8-aaf7-e7769c125282 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Sep 12 12:02:47.687508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 587/1172] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:47.766212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:47.766956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:47.771173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:47.775950 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.776762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.777283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.778097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:47.778763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:47.779195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:47.796927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:47.919575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:47.923017 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:47.930095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:47.931554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:47.932731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3740d0d9-87aa-4d90-9f6d-23c6ed52407a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.171336 Sep 12 12:02:47.933285 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 586/1173] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:47 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:48.381396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:02:48.386264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:48.387046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:48.393447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.393931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.394903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.395666 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.396126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.396559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.430391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.430920 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.431362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.431815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'fault' on Instance uuid f66e13ac-f5d7-4903-afbd-8a6059142cec {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:02:48.466417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:48.467201 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:48.475607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:48.476842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.477337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.477974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.478722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.479218 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.479657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.483776 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70af461b-dcba-4d21-8c3e-bfc8a2454ce5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 200 len: 1331 microversion: 2.1 time: 0.103324 Sep 12 12:02:48.484966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 588/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:48 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:48.625048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:48.652802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3a790f0b-f5e4-4802-9f16-b7c7d16e57f6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.190151 Sep 12 12:02:48.659129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 587/1175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:48 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:48.959534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:48.960056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:48.966145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.966669 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.967111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:48.967837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:48.968292 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:48.968719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:49.094906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:49.103145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:49.104583 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:49.105738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e79f5c3-a66e-4b69-899c-1d4dbfa06b5f tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1745 microversion: 2.20 time: 0.150914 Sep 12 12:02:49.106294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 589/1176] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:48 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:49.507799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:49.508417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:49.514786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:49.515264 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:49.515697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:49.516371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:49.516825 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:49.517250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:49.530798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec HTTP/1.1 Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:02:49.532418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:02:49.534065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'f66e13ac-f5d7-4903-afbd-8a6059142cec'} Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:02:49.535591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:02:49.537427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:02:49.538875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:02:49.538875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-715e71b8-222e-4515-8949-6738fe6b8a91 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 404 len: 111 microversion: 2.1 time: 0.029931 Sep 12 12:02:49.538875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 588/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:49 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:02:49.543365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a734e3e-663e-47e1-ba6b-2ddae327cf92 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '.version_select at 0x7fc93a2401f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:49.562023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a734e3e-663e-47e1-ba6b-2ddae327cf92 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317349004" status: 202 len: 0 microversion: 2.1 time: 0.022444 Sep 12 12:02:49.562600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 590/1178] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 12 12:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317349004 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:02:49.683943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:49.684722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:49.691166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:49.691757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:49.692197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:49.693033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:49.693524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:49.693949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:49.835544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:49.843240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8bf20d8d-928d-4418-8b7f-a2fca037f323 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.163606 Sep 12 12:02:49.843835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 589/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:49 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:50.131640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:50.132362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:50.138227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:50.138809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:50.139334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:50.141123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:50.142110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:50.142655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:50.160529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a6b6aa03-eb33-49a1-87d5-437e161e603e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: .version_select at 0x7fc93a4470d0>, body: {"keypair": {"name": "tempest-keypair-1911532086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/X50QAmPcaGRqRwSkDMlt+D8D4ZUDovz1man1pa4DfK43o2Aq6pO4vXdcbPXoDQ0yPOq76HDICzap2SCkFKYXVkfElje3sVxywy3vQ41U5A3Qz2tIbd5DN/J6KuPQiSA=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:50.175315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-a6b6aa03-eb33-49a1-87d5-437e161e603e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:50.179911 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-a6b6aa03-eb33-49a1-87d5-437e161e603e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:50.204099 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a6b6aa03-eb33-49a1-87d5-437e161e603e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047443 Sep 12 12:02:50.204703 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 590/1180] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 12:02:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:50.315855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:50.323916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:50.325360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:50.326701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c5ed31f-a27c-4a55-a3c4-30d9ed7ad7f4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1745 microversion: 2.20 time: 0.199844 Sep 12 12:02:50.327326 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 591/1181] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:50 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:50.867519 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:50.868743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:50.875488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:50.875990 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:50.876435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:50.877142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:50.877781 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:50.878216 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:51.071629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:51.079597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-534601be-e13d-447f-b862-ce63e744cebf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.216600 Sep 12 12:02:51.080171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 591/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:50 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:51.353042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:51.353878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:51.360334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:51.360819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:51.361255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:51.361943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:51.362398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:51.362852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:51.498485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:51.506836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:51.508269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:51.509420 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-588725c3-3764-4d13-980d-b89c5f973c5a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1745 microversion: 2.20 time: 0.160338 Sep 12 12:02:51.509977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 592/1183] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:51 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:51.633291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1884573974", "imageRef": "f329095b-2443-46ca-9b3c-feca6f6fbe25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea7071fe-73d4-4a9c-bf82-37346c7e58c4"}], "security_groups": [{"name": "tempest-securitygroup--1676898095"}], "key_name": "tempest-keypair-1911532086", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:51.741806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] validate_networks() for [('ea7071fe-73d4-4a9c-bf82-37346c7e58c4', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:02:52.103843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:52.104578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:52.110650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.111141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.111584 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.112280 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.112740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.113261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.132779 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:02:52.133290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:02:52.133663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:02:52.134072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:02:52.134536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:02:52.143174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.143651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.144088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.145316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.145769 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.146192 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.163380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:02:52.167333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Getting quotas for user f58a59c389cf4b3198a6c452eb2772d6 and project 7225740627444e3a97ff730460c52e7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:02:52.178810 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:02:52.181127 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f329095b-2443-46ca-9b3c-feca6f6fbe25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:02:52.231758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed58f74d-038b-4f83-a5f1-3b03300bfaf6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.602785 Sep 12 12:02:52.232593 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 592/1184] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:02:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 12:02:52.243434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5a56ab41-d0ef-4a98-8a6e-861f604ab6c9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:52.244050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5a56ab41-d0ef-4a98-8a6e-861f604ab6c9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:52.256625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:52.266923 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65b07493-e8e5-4c89-946a-014f26fb38ad tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.166942 Sep 12 12:02:52.267824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 593/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:52 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:52.300334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5a56ab41-d0ef-4a98-8a6e-861f604ab6c9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:52.307681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5a56ab41-d0ef-4a98-8a6e-861f604ab6c9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1242 microversion: 2.1 time: 0.068071 Sep 12 12:02:52.308299 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 593/1186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:52 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:52.536492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:52.537100 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:52.543782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.544263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.544695 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.545386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.545836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.546257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.680118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:52.688634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:52.690055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:52.691267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9038f326-f1eb-41ce-ad8f-70d8b1c29e3b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1745 microversion: 2.20 time: 0.159696 Sep 12 12:02:52.692607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 594/1187] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:52 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:52.845291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "name": "network-vif-plugged", "status": "completed", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:52.856173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:52.856658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:52.857256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:52.868782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] Creating event network-vif-plugged:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:02:52.873647 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-f20c5605-d062-4e56-a544-1aa05032ef17 req-33172aec-2657-49e1-bd6f-f620595c469e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Sep 12 12:02:52.874241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 594/1188] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:53.290413 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:53.291060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:53.297242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.297727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.298161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.298881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.299332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.299756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.331700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:53.333315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:53.341346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.342154 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.342842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.343724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.343999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.344610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.421519 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:53.430276 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-76cddf94-31c9-4426-a23f-ac9d36a4ead4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1294 microversion: 2.1 time: 0.103715 Sep 12 12:02:53.430890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 595/1189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:53 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:53.450096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:53.458905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f66d457-44ab-4448-a43e-6a4b1a200fb2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.173223 Sep 12 12:02:53.459474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 595/1190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:53 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:53.718607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:53.719130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:53.725943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.726416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.726872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.727548 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:53.727996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:53.728418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:53.860061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:53.868627 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:53.870132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:53.871335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d61a156a-ada7-4a68-9e41-95834d859ed9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1745 microversion: 2.20 time: 0.156858 Sep 12 12:02:53.871902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 596/1191] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:53 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:54.459780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:54.460470 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:54.467845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.468601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.469043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:54.470831 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.471518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.472021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:54.484607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:54.485220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:54.494732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.495227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.495658 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:54.496499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.497734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.498163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:54.559346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:54.572841 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6be43ff5-039d-4371-873c-b9eefad4d660 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1300 microversion: 2.1 time: 0.119763 Sep 12 12:02:54.573757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 596/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:54 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:54.657713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:54.668137 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2475f992-475b-482c-a02f-09f3666bb815 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.188115 Sep 12 12:02:54.668908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 597/1193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:54 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:54.898271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:54.899219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:54.910419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.917135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.917770 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:54.918708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:54.919235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:54.919921 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:55.246384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:55.259360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:55.263413 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:55.266347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c6f8e12-ee7e-4977-b4d1-daf464e441b7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.372476 Sep 12 12:02:55.267808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 597/1194] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:54 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:55.599740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:55.600982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:55.608051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:55.608894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:55.609526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:55.610430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:55.611078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:55.611679 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:55.692450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:55.693733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:55.705634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:55.706150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:55.712023 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:55.713124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:55.717725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:55.718191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:55.785619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:55.798822 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d1460558-fa6d-4a8b-b4ec-e03a8230aaac tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.202006 Sep 12 12:02:55.801176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 598/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:55 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:56.274095 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:56.282882 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c01b8555-aa2c-4c4b-85c0-b3efadc77b6c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.595085 Sep 12 12:02:56.283454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 598/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:55 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:56.294465 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:56.297373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:56.311147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:56.311971 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:56.312595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:56.314267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:56.314913 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:56.315976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:56.408504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40359b1b-18bb-492f-b711-066921ccbd1c", "tag": "2848a8ee-8fa8-467e-947d-53639185ac2d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:56.424824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:56.427732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:56.428587 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:56.446026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] Creating event network-changed:2848a8ee-8fa8-467e-947d-53639185ac2d for instance 40359b1b-18bb-492f-b711-066921ccbd1c on hv-cinder-85331 Sep 12 12:02:56.462089 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1bdad04e-a0db-4007-9298-f89df65f0fd3 req-041fdf64-7d6a-41e4-b400-09908f2dda64 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057673 Sep 12 12:02:56.462730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 599/1197] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:02:56.498800 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:56.508286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:56.510096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:56.511755 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6e054b0-5f30-439e-8847-d56c7a914476 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.222064 Sep 12 12:02:56.529202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 599/1198] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:56 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:56.833864 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:56.835341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:56.842165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:56.843158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:56.843977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:56.844971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:56.845629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:56.846256 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.069111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:57.078294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e83007f-3e14-4af8-92ec-165e8df026e5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.250305 Sep 12 12:02:57.079451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 600/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:56 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:57.210902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "name": "network-vif-plugged", "status": "completed", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:02:57.227921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:57.228317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:57.228770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.245559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] Creating event network-vif-plugged:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:02:57.251283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e4bf5fa8-72e3-4487-a97c-388ce774efb2 req-7a266a41-a324-402b-9253-f4e1d0725c87 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046399 Sep 12 12:02:57.252209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 600/1200] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:02:57.312172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:57.313973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:57.321548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:57.322368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:57.323057 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.324148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:57.324817 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:57.325468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.467711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:57.476802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab1e357b-8fde-4424-95bc-ed810c033023 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.168494 Sep 12 12:02:57.477369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 601/1201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:57 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:57.544187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:57.544973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:57.552389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:57.552871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:57.553310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.553996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:57.554698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:57.555353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:57.700607 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:57.709251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:57.710725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:57.711872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-38ee34b4-8e82-49cd-8efa-0d813096da49 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.172585 Sep 12 12:02:57.713167 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 601/1202] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:57 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:58.104856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:58.105541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:58.117701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.119683 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.120134 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.120848 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.124448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.125006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.288205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:58.296835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3f68f59-fbd4-4469-93b3-7b9e6c814596 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.196042 Sep 12 12:02:58.297854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 602/1203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:58 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:02:58.499943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:58.500489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:58.507432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.507922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.508426 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.509312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.509768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.510196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.657208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:58.666116 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b09136f0-c638-49d9-be71-e1d076a0a201 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.170311 Sep 12 12:02:58.666719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 602/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:58 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:58.741079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:58.741738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:58.748451 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.748830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.749298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.750080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:58.750492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:58.750995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:58.887254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:58.895806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:58.897265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:58.898486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0286750-f2cb-4ef0-85bf-756eb2602013 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.162310 Sep 12 12:02:58.899238 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 603/1205] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:58 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:02:59.321999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:59.322753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:59.329092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.329575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.330010 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:59.330804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.331250 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.331706 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:59.476061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:02:59.483976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b2b8ce4d-60c0-4fde-9866-7c46def15c66 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.165911 Sep 12 12:02:59.485297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 603/1206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:59 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:02:59.695542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:59.696353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:59.702763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.703517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.703967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:59.704686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.705138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.705701 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:59.928164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:02:59.929395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:02:59.937178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.937940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.938603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:02:59.939477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:02:59.940098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:02:59.941490 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:00.010613 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:00.014303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:00.031721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5e5d9bb-6428-4436-a625-e9d9b14b5c2c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.344817 Sep 12 12:03:00.033056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 604/1207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:02:59 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:00.114104 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:00.124862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:00.126673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:00.127877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be754b77-f6b4-4cc0-9280-c4067d5b30e4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.205073 Sep 12 12:03:00.128997 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 604/1208] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:02:59 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:03:00.510218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:00.510853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:00.517227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:00.517673 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:00.518096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:00.519599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:00.519599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:00.519903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:00.825046 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:00.837916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1236374-7583-4be6-8f18-eb44a6f7f66a tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.331797 Sep 12 12:03:00.838856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 605/1209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:00 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:01.058552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:01.060291 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:01.071396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.072165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.072828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.073725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.074401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.075075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.158144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:01.160610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:01.168317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.169108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.170400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.177488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.178285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.178988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.298891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:01.313895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dc88b0bf-5b98-49d0-83d3-b97665ca9a3d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1259 microversion: 2.1 time: 0.259774 Sep 12 12:03:01.333213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 605/1210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:01 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:01.340213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40359b1b-18bb-492f-b711-066921ccbd1c", "name": "network-vif-plugged", "status": "completed", "tag": "2848a8ee-8fa8-467e-947d-53639185ac2d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:01.363328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.364122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.364724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.389347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] Creating event network-vif-plugged:2848a8ee-8fa8-467e-947d-53639185ac2d for instance 40359b1b-18bb-492f-b711-066921ccbd1c on hv-cinder-85331 Sep 12 12:03:01.403771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-60d7fcba-cf9d-4876-b2fb-f8db9f254c94 req-e9a6358d-0d4f-4147-8c01-1d667a317358 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068310 Sep 12 12:03:01.404719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 606/1211] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:03:01.458127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:01.467092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:01.468796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:01.470264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3700aadb-d2d8-4747-baff-4be619cbeef5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.316127 Sep 12 12:03:01.470862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 606/1212] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:01 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:03:01.864652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:01.865337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:01.872775 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.873306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.873843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:01.874724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:01.875170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:01.875591 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.034837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.043171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-07f3340a-b88c-4543-a672-f8c41532df99 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.184190 Sep 12 12:03:02.058968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 607/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:01 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:02.348204 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:02.348994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:02.357398 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.358007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.360262 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.361324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.361955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.362691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.498873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:02.500029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:02.506652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:02.508185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=12 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:02.511267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.511948 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.512633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.513559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.514188 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.514724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.527911 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.539714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7676f24a-eba3-47a6-bf90-459d5ac17820 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1442 microversion: 2.1 time: 0.195945 Sep 12 12:03:02.540903 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 607/1214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:02 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1442 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:02.577872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:02.579001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:02.585880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.588504 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.589036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.589860 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:02.590325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:02.592382 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:02.773928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.779084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:02.788081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.790206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.792219 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:02.792473 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d1b2f7b2-2559-4d72-8e2a-1eaf77cba0a0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.297341 Sep 12 12:03:02.803138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 608/1215] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:02 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:03:02.805029 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56096494-7478-40b5-97bf-d395248a1f6a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1442 microversion: 2.1 time: 0.236974 Sep 12 12:03:02.822741 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 608/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:02 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1442 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:03:03.069036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:03.070319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:03.076439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:03.078120 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:03.078856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:03.079516 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:03.080854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:03.081500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:03.087547 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:03.318170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:03.327859 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be93046c-4a35-4e7a-8aac-5252e6bf422b tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.262744 Sep 12 12:03:03.328402 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 609/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:03 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:03.833624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:03.838998 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:03.845988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:03.847417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:03.848047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:03.848937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:03.849699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:03.850306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:04.089960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:04.099884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:04.101372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:04.102816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77c8225d-a39f-49d1-be9a-36052226a711 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.273592 Sep 12 12:03:04.119351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 609/1218] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:03 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:04.356158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:04.358026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:04.365930 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:04.366412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:04.367393 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:04.368256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:04.368871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:04.369452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:04.512829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:04.521735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ee5dff1-06b0-42a3-a582-555217776fe5 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1368 microversion: 2.1 time: 0.171633 Sep 12 12:03:04.522323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 610/1219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:04 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:04.918235 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:04.933689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:04.938086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:04.938545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:04.957041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] Creating event network-changed:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:03:04.962797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a265bcd3-77f4-45c5-aca0-29f70da20938 req-5f7733eb-ad6d-49bd-9c87-699624bf5331 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049005 Sep 12 12:03:04.963724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 610/1220] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:03:05.130286 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:05.131999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:05.140765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.141265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.141723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.142645 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.144444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.145046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.302635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:05.325938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:05.332380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:05.333900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eb017cdf-564b-456a-a051-d9dc6e7f3278 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.208218 Sep 12 12:03:05.334691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 611/1221] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:05 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:05.550370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:05.552322 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:05.560818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.561545 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.562174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.563093 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.564294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.564900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.744944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:05.753540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22732dfd-8434-4b5c-91ba-42484e44a127 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1558 microversion: 2.1 time: 0.208524 Sep 12 12:03:05.767154 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 611/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:05 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:05.782575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:05.783689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:05.795637 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.798014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.798843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.800379 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:05.801011 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:05.801628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:05.901067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4566317e-63ed-41b6-bde7-f64faf0cb618 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122426 Sep 12 12:03:05.906899 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 612/1223] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 12 12:03:05 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:03:06.358845 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:06.359444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:06.367027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:06.367869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:06.368475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:06.370005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:06.370662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:06.371408 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:06.526080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:06.535033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:06.537135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:06.538653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99b3293c-94ff-45e9-8518-b6521500e54b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1740 microversion: 2.20 time: 0.183879 Sep 12 12:03:06.539459 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 612/1224] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:06 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:06.980505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40359b1b-18bb-492f-b711-066921ccbd1c", "tag": "2848a8ee-8fa8-467e-947d-53639185ac2d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:06.990073 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:06.990648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:06.991163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:07.001984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] Creating event network-changed:2848a8ee-8fa8-467e-947d-53639185ac2d for instance 40359b1b-18bb-492f-b711-066921ccbd1c on hv-cinder-85331 Sep 12 12:03:07.008038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-ce8aa547-787a-4361-8875-9e7bddf06bce req-06936a06-19ed-4187-ae11-a4970ee76651 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032081 Sep 12 12:03:07.008910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 613/1225] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:03:07.567904 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:07.568497 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:07.574946 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:07.575415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:07.575854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:07.576555 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:07.577010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:07.577443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:08.062850 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:08.071287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:08.072907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:08.074180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fdee49f8-f29b-4fec-8423-c2fee3646536 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1722 microversion: 2.20 time: 0.510397 Sep 12 12:03:08.074857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 613/1226] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:07 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:03:09.103636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:09.104333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:09.111111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:09.111597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:09.112652 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:09.113354 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:09.113815 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:09.114245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:09.249440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:09.257758 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:09.259154 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:09.260311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-525d5202-86cc-4bda-b238-4934937219f0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1722 microversion: 2.20 time: 0.160998 Sep 12 12:03:09.260869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 614/1227] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:09 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:10.420595 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:10.421289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:10.428285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:10.428797 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:10.429230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:10.429940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:10.430391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:10.430846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:10.567596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:10.575942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:10.577383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:10.578564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1fa7011-d128-4ac3-87fe-85c4308a2a54 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1722 microversion: 2.20 time: 0.297268 Sep 12 12:03:10.579123 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 614/1228] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:10 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:11.126247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "name": "network-vif-unplugged", "status": "completed", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:11.137079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:11.137557 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:11.138176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:11.150161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.compute.server_external_events [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] Unable to find a host for instance 873cc9f8-eafa-40df-8e7e-34277921befb. Dropping event network-vif-unplugged {{(pid=120424) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 12:03:11.151061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e9a242c7-f470-4099-9aa9-e6e108887263 req-a84b53d4-4791-4596-9885-1c9dea88f5a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028863 Sep 12 12:03:11.151640 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 615/1229] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 12 12:03:11.604854 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:11.605463 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:11.612206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:11.612699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:11.613142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:11.613837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:11.614296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:11.614759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:11.746314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:11.754330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:11.755809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:11.756966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-732ce79a-dbf2-4bb1-add3-9aed8906baef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1665 microversion: 2.20 time: 0.156117 Sep 12 12:03:11.757523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 615/1230] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:11 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:11.782195 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98e0b32b-c290-4b47-8b21-2ce835df9a0f"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:11.785462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:11.791432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:11.791921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:11.792364 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:11.793059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:11.793524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:11.793955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.053857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b9cd8bf8-305d-4cb0-b2c2-1e777f6795df tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275665 Sep 12 12:03:12.054472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 616/1231] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Sep 12 12:03:11 2022] POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 12:03:12.179414 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:12.179907 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:12.185732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.186212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.186768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.187456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.187909 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.188335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.437881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-569f8a0f-1f83-4fb9-9fe0-35835430f9dd tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments/98e0b32b-c290-4b47-8b21-2ce835df9a0f" status: 202 len: 0 microversion: 2.20 time: 0.262477 Sep 12 12:03:12.438503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 616/1232] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Sep 12 12:03:12 2022] DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments/98e0b32b-c290-4b47-8b21-2ce835df9a0f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:03:12.499526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:12.500117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:12.506744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.507226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.507689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.508385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.508837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.509261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.539536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120424) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 12:03:12.603710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d3632216-9c6f-4ced-b86d-f51fbd10fe76 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/action" status: 202 len: 0 microversion: 2.20 time: 0.108052 Sep 12 12:03:12.604320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 617/1233] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 12 12:03:12 2022] POST /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:03:12.613170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:12.613778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:12.619855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.620341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.620780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.621484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:12.621966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:12.622390 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:12.754641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:12.762702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:12.764301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:12.765484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63da72f6-3b2d-455c-8fc8-97b3c725c44b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1673 microversion: 2.20 time: 0.156861 Sep 12 12:03:12.766044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 617/1234] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:12 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:13.791257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:13.791868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:13.797778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:13.798258 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:13.798725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:13.799814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:13.800823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:13.801337 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:13.939169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:13.947142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:13.948584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:13.949720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c0b84498-8b75-461a-a274-de2c9089ae7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.162894 Sep 12 12:03:13.950269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 618/1235] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:13 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:14.975522 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:14.976138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:14.983010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:14.983488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:14.984176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:14.984869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:14.985323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:14.985748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:15.126009 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:15.135020 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:15.136457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:15.137614 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9d75a79-c748-4905-905a-b68c632ae823 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.166211 Sep 12 12:03:15.138161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 618/1236] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:14 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:16.167667 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:16.168589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:16.178424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:16.179176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:16.179830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:16.180909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:16.181597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:16.182244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:16.331760 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:16.340487 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:16.341917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:16.343107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e84f4966-cd0b-4648-a5fe-aa167c62e1d5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.181745 Sep 12 12:03:16.343666 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 619/1237] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:16 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:17.369690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:17.370210 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:17.373119 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:17.380602 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:17.381717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:17.382386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:17.383437 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:17.384282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:17.384777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:17.525113 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:17.527308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:17.535960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:17.537393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:17.538591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7fefa9c-132d-4ca0-953f-0abe92e67ff8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.172952 Sep 12 12:03:17.539575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 619/1238] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:17 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:18.565616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:18.566310 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:18.572854 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:18.573339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:18.573771 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:18.574468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:18.574941 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:18.575363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:18.711174 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:18.719663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:18.721119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:18.722328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-19af8771-f757-4531-a33e-d293bdd1e6ff tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.160703 Sep 12 12:03:18.722944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 620/1239] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:18 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:19.748174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:19.748971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:19.756704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:19.757194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:19.757634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:19.758341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:19.758825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:19.759257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:19.897954 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:19.906054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:19.907554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:19.909727 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33396a86-58b0-4e8a-a6d3-57766fbec110 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.165247 Sep 12 12:03:19.910288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 620/1240] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:19 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:20.935280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:20.935891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:20.942470 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:20.942984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:20.943417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:20.944111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:20.944566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:20.944987 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:21.087414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:21.095851 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:21.097831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:21.099030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-08a96ef1-c0cc-4457-9a18-3a2a1cb02fa2 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.167686 Sep 12 12:03:21.103194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 621/1241] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:20 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:22.125378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:22.126021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:22.132865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:22.133336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:22.133798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:22.134657 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:22.135150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:22.135576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:22.272498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:22.281906 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:22.283546 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:22.284953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cdb941c-8eaa-4ff3-8353-10d5dc8126c8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.163547 Sep 12 12:03:22.285617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 621/1242] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:22 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:23.312610 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:23.313339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:23.321301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:23.321792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:23.322229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:23.322966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:23.323428 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:23.323862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:23.469231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:23.478375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:23.479900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:23.481165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-41e9d0e4-0898-4799-9f4d-f76288282978 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.173227 Sep 12 12:03:23.481827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 622/1243] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:23 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:24.507185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:24.507863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:24.514203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:24.514719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:24.515163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:24.515857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:24.516315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:24.516745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:24.661188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:24.669523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:24.671007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:24.672184 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dacf60df-80c6-48c2-8d64-85f1b2c81e7c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.169684 Sep 12 12:03:24.672750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 622/1244] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:24 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:25.699554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:25.700193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:25.706588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:25.707665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:25.708178 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:25.708862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:25.709312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:25.709735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:25.727288 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:25.842143 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:25.850194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:25.851741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:25.852893 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b87e1a1-f695-44ad-a301-ab57f2ca5bf4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.157329 Sep 12 12:03:25.853456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 623/1245] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:25 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:26.879662 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:26.880325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:26.886785 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:26.887271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:26.887717 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:26.888415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:26.888901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:26.889332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:27.018400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:27.026695 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:27.028125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:27.029264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b59d770b-f5c6-4b7b-9226-45cd7f18a8af tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.154357 Sep 12 12:03:27.029827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 623/1246] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:26 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:28.054625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:28.055238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:28.061655 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:28.062137 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:28.062604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:28.063294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:28.063754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:28.064179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:28.201564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:28.210232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:28.211702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:28.212863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-554358e5-b20c-4cbe-a81e-bbcadae7ca11 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.162464 Sep 12 12:03:28.213422 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 624/1247] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:28 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:29.239759 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:29.240366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:29.246757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:29.247230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:29.247663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:29.248341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:29.248790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:29.249211 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:29.378405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:29.386397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:29.387847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:29.388988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-041a2c88-e79d-4d9e-9755-99de81f7d1ef tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.153892 Sep 12 12:03:29.389538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 624/1248] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:29 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:30.414603 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:30.415132 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:30.421564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:30.422051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:30.422491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:30.423205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:30.423660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:30.424085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:30.551752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:30.559751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:30.561215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:30.562374 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6f865435-80ed-4cd2-adf3-84b030ce0bba tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.151921 Sep 12 12:03:30.562967 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 625/1249] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:30 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:31.592700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:31.593336 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:31.600690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:31.601177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:31.601626 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:31.602324 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:31.602819 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:31.603255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:31.731363 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:31.740056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:31.741493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:31.742681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a26990c2-422a-4fa1-9d47-b9b18164d8e5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.153944 Sep 12 12:03:31.743240 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 625/1250] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:31 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:32.767553 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:32.768152 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:32.774479 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:32.774979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:32.775405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:32.776082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:32.776531 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:32.776949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:32.913398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:32.921731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:32.923297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:32.924459 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8ebd91ef-45c1-48b3-a20a-8939b1514376 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.160863 Sep 12 12:03:32.926015 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 626/1251] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:32 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:33.950365 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:33.950993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:33.958118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:33.958622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:33.959054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:33.959732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:33.960179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:33.960599 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:34.091418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:34.099355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:34.100778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:34.101912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c73e20f-4c1e-4666-b6c2-f2b1e9894288 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.155440 Sep 12 12:03:34.102473 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 626/1252] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:33 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:35.127485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:35.128580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:35.131041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:35.137128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:35.137604 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:35.138040 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:35.138762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:35.139215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:35.139638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:35.270028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:35.278204 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:35.279696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:35.280849 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7814892d-cc07-4b2f-8dca-09a8b73ffce7 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.157367 Sep 12 12:03:35.281713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 627/1253] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:35 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:36.307452 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:36.308069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:36.314548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:36.315036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:36.315672 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:36.316372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:36.316834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:36.317265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:36.444086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:36.452101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:36.453546 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:36.454734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29679323-b3bd-4f5d-974b-917f40694be4 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.151448 Sep 12 12:03:36.455301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 627/1254] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:36 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:03:37.316763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "name": "network-vif-plugged", "status": "completed", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:37.327543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:37.328097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:37.328538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:37.339763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] Creating event network-vif-plugged:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:03:37.344742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-787167e6-1fb9-4cc5-8d5c-f6a6c034abc0 req-71df5b5b-ce79-4aa1-ab54-e66da046677d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Sep 12 12:03:37.345491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 628/1255] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:03:37.481866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:37.482532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:37.489863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:37.490351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:37.490822 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:37.491533 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:37.491987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:37.492418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:37.706641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:37.714747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:37.716202 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:37.717381 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81f67815-597e-4cf8-87a2-35083783c2a6 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.239556 Sep 12 12:03:37.717944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 628/1256] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:37 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:38.744096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:38.744731 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:38.750897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:38.751371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:38.751828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:38.752693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:38.753239 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:38.753785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:38.889552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:38.898702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:38.900133 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:38.901302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a05f29c4-936f-41d3-a8b8-a02f81da9cb5 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.162249 Sep 12 12:03:38.901864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 629/1257] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:38 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:39.927078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:39.927704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:39.934263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:39.934772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:39.935205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:39.935891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:39.936332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:39.936747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:40.069692 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:40.078271 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:40.079948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:40.081900 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2309e25d-964c-468c-86ca-b731905b8897 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.159017 Sep 12 12:03:40.082653 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 629/1258] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:39 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:41.107130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:41.107741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:41.115154 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:41.115747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:41.116283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:41.117049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:41.117536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:41.118598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:41.248221 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:41.257594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:41.259082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:41.260246 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c2bdc1cb-e7da-4356-ad82-9ca36712fb1a tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.157142 Sep 12 12:03:41.261059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 630/1259] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:41 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:42.285702 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:42.286391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:42.292855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:42.293338 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:42.293772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:42.294462 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:42.294935 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:42.295508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:42.427793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:42.435700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:42.437129 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:42.438299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3cb559b3-78dc-48f8-b067-289d6d8cdf65 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1731 microversion: 2.20 time: 0.157115 Sep 12 12:03:42.438894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 630/1260] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:42 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:43.464122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:43.464662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:43.471004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:43.472060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:43.472496 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:43.473179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:43.473628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:43.474055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:43.609256 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:43.617973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:43.619454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:43.620608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4a24e96-b7df-4244-aec8-51000357ada0 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1718 microversion: 2.20 time: 0.160520 Sep 12 12:03:43.621176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 631/1261] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:03:43 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:03:51.185972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1706310438", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051257965", "security_groups": [{"name": "tempest-secgroup-smoke-604561767"}], "block_device_mapping_v2": [{"uuid": "9e86e52a-1c87-4bae-9b56-c9f292883bb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7979205-0c82-4090-b1b7-10cd6c0b471c"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:51.196741 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=24 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:51.300301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] validate_networks() for [('d7979205-0c82-4090-b1b7-10cd6c0b471c', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:03:51.675027 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:03:51.675458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:03:51.675941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:03:51.676444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:03:51.676863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:03:51.685691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:51.686179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:51.686656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:51.687395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:51.687856 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:51.688291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:51.695486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=68 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:51.706334 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:03:51.710956 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Getting quotas for user fb4bb9cd41cd46ddb87a746e732a948f and project 6d05fbbec08d43468068ce162f427eeb. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:03:51.766265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:03:51.768465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e86e52a-1c87-4bae-9b56-c9f292883bb0',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:03:51.895761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70fe022f-855b-4bcd-849e-981d90641441 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713551 Sep 12 12:03:51.896412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 631/1262] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:03:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 12:03:51.908045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-557dcc6d-6718-4e38-8cea-1a18dd5a454a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:51.908650 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-557dcc6d-6718-4e38-8cea-1a18dd5a454a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:51.964005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-557dcc6d-6718-4e38-8cea-1a18dd5a454a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:51.970844 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-557dcc6d-6718-4e38-8cea-1a18dd5a454a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1095 microversion: 2.1 time: 0.066786 Sep 12 12:03:51.971408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 632/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:51 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:52.994714 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:52.997035 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:53.006699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:53.007433 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:53.008056 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:53.009124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:53.009826 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:53.010486 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:53.075206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:53.084199 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2196ad26-7111-4d8c-b159-5b9868284a8f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1193 microversion: 2.1 time: 0.094628 Sep 12 12:03:53.090823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 632/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:52 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:54.109840 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:54.111397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:54.114075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=46 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:03:54.121385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:54.121873 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:54.122306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:54.123225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:54.123657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:54.124078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:54.266122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:54.274899 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-937e29de-4684-42ee-a585-e721af9e8ba3 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.170429 Sep 12 12:03:54.275479 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 633/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:54 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:54.598707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057ebe0-ef52-42be-8192-758b1e62c589", "tag": "6553671d-60e7-4e61-bf1b-d839411b347c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:03:54.609568 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:54.610189 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:54.610646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:54.622293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] Creating event network-changed:6553671d-60e7-4e61-bf1b-d839411b347c for instance 2057ebe0-ef52-42be-8192-758b1e62c589 on hv-cinder-85331 Sep 12 12:03:54.627227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0e2616da-092b-4285-ac56-a6f83e88c7b5 req-879faa81-0644-44fe-b394-f7031a839edb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032857 Sep 12 12:03:54.627827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 633/1266] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:03:55.298615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:55.299227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:55.306169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:55.306686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:55.307122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:55.307808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:55.308261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:55.308685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:55.440853 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:55.449287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-db2b7c48-9b1f-439b-9cd6-1a46904d6fea tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.154612 Sep 12 12:03:55.449858 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 634/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:55 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:56.474474 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:56.475192 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:56.481477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:56.481966 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:56.482411 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:56.483132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:56.483594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:56.484021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:56.687890 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:56.695829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9faaae1b-bc2e-465d-a0bb-c2a9fe3d6c50 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.226863 Sep 12 12:03:56.696409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 634/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:56 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:57.718982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:57.719590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:57.726107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:57.726615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:57.727049 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:57.727730 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:57.728182 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:57.728601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:57.858543 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:57.866827 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-810d7420-9a2c-4a6d-b31c-b368a921d5de tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.151687 Sep 12 12:03:57.867389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 635/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:57 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:03:58.890308 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:03:58.890922 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:03:58.897359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:58.898539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:58.899263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:58.899958 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:03:58.900418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:03:58.900847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:03:59.040490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:03:59.048362 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48e67232-b4a8-4fa2-b071-14018057e9c4 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.162281 Sep 12 12:03:59.048924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 635/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:03:58 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:00.071407 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:00.072070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:00.078740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:00.079229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:00.079672 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:00.080417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:00.080908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:00.081343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:00.213051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:00.220804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cd6aeaba-4eea-4c48-bc21-cc3862641a1a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.153589 Sep 12 12:04:00.221370 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 636/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:00 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:01.244401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:01.245003 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:01.251372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:01.251851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:01.252285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:01.252969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:01.253419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:01.254121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:01.387586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:01.395127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19ba7e04-fbad-4472-9489-5c12fa9858e6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.155226 Sep 12 12:04:01.395710 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 636/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:01 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:02.420284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:02.420952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:02.423051 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:02.428500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:02.429237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:02.430209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:02.430919 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:02.431373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:02.431798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:02.565572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:02.574041 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c0df82d0-7bf8-414d-8048-84287ad343af tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.157626 Sep 12 12:04:02.574693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 637/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:02 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:03.597227 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:03.597873 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:03.599830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:03.600479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:03.606865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:03.607342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:03.607779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:03.608461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:03.608916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:03.609368 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:03.739884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:03.747981 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22f6d5e9-efac-4f6c-89ad-ed30aada9342 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.154893 Sep 12 12:04:03.748540 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 637/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:03 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:04.771335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:04.772155 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:04.780179 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:04.780665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:04.781098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:04.781798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:04.782251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:04.782705 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:04.917449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:04.926691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-adbae4b3-0e6b-4eac-a45e-b2eeff40d980 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.159106 Sep 12 12:04:04.927126 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 638/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:04 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:05.949102 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:05.949716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:05.956135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:05.956617 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:05.957064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:05.957744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:05.958201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:05.958671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:06.092026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:06.100293 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24b9aa98-fa1c-4661-9adf-7e369a2a7fbd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.155007 Sep 12 12:04:06.100840 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 638/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:05 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:07.124108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:07.124726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:07.127090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=26 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:07.132922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:07.133527 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:07.134316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:07.135037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:07.135504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:07.135928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:07.521045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:07.529857 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7488904-31e5-4777-8efb-cbc9ac86c383 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.409526 Sep 12 12:04:07.530432 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 639/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:07 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:07.603406 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2057ebe0-ef52-42be-8192-758b1e62c589", "name": "network-vif-plugged", "status": "completed", "tag": "6553671d-60e7-4e61-bf1b-d839411b347c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:04:07.612876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:07.613347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:07.613774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:07.624902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] Creating event network-vif-plugged:6553671d-60e7-4e61-bf1b-d839411b347c for instance 2057ebe0-ef52-42be-8192-758b1e62c589 on hv-cinder-85331 Sep 12 12:04:07.629708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b5504532-1f1b-46a8-bfbb-890db62d651c req-808f005e-2753-485b-a2ec-a7567fd9b26a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100509 Sep 12 12:04:07.630275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 639/1278] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:04:08.553209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:08.553818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:08.561161 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:08.561638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:08.562070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:08.562786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:08.563237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:08.563659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:08.690985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:08.698663 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-150bdcaa-ce20-4b4d-98ad-d5c9bcc50e6f tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.149327 Sep 12 12:04:08.699238 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 640/1279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:08 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:09.725341 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:09.726032 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:09.732116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:09.732591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:09.733024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:09.733698 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:09.734146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:09.734592 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:09.867604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:09.876049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ba755b1-5ee7-4adc-bc96-ab854f595737 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1266 microversion: 2.1 time: 0.155444 Sep 12 12:04:09.876607 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 640/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:09 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:10.899013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:10.899802 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:10.906220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:10.906744 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:10.907191 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:10.907874 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:10.908325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:10.908751 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:11.044635 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:11.052415 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0f1e7913-c207-4634-ae6b-b80317cf55fc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1452 microversion: 2.1 time: 0.157257 Sep 12 12:04:11.052992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 641/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:10 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:11.080543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:11.081158 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:11.088646 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:11.089138 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:11.089576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:11.090275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:11.090782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:11.091209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:11.221778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:11.229422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a98c4ab9-e56a-485c-917a-d6b2b984ced6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1452 microversion: 2.1 time: 0.152713 Sep 12 12:04:11.229984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 641/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:11 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:12.879384 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057ebe0-ef52-42be-8192-758b1e62c589", "tag": "6553671d-60e7-4e61-bf1b-d839411b347c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:04:12.889448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:12.890406 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:12.890866 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:12.902526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] Creating event network-changed:6553671d-60e7-4e61-bf1b-d839411b347c for instance 2057ebe0-ef52-42be-8192-758b1e62c589 on hv-cinder-85331 Sep 12 12:04:12.907523 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-8393d568-6f46-43be-92b0-9629d023fa9f req-c4d2681f-660a-46a7-b892-9c4eea8a7c42 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Sep 12 12:04:12.908138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 642/1283] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:21.033665 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:21.034269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:21.041041 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:21.042111 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:21.042774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:21.043510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:21.043970 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:21.044401 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:21.067363 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f4865f8-af27-4d02-9834-6cafc12d490b tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/ips" status: 200 len: 147 microversion: 2.1 time: 0.037706 Sep 12 12:04:21.067930 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 642/1284] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:04:21 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:23.467019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=7 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:23.467763 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:23.471993 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:04:23.474439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:23.481932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:23.482416 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:23.482875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:23.483560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:23.484021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:23.484439 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:23.768551 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f6966439-9bf8-4662-aebf-b2ed4cef80ee tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302906 Sep 12 12:04:23.769245 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 643/1285] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:04:23 2022] POST /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:31.309538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:31.311750 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:31.314505 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:31.315174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=57 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:31.321746 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:31.322224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:31.322689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:31.323375 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:31.323825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:31.324246 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:31.354008 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bc88f45-ced9-4d77-92f8-25e8f187ae2c tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Sep 12 12:04:31.354575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 643/1286] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:04:31 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:31.366718 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:31.367290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:31.373598 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:31.374072 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:31.374506 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:31.375220 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:31.375668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:31.376091 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:31.404948 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0e452ccf-be2f-4a73-b9c7-2a6048fef20f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34" status: 200 len: 194 microversion: 2.1 time: 0.043546 Sep 12 12:04:31.405526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 644/1287] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 12 12:04:31 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:32.731195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26fec6bd-4006-4a4e-9202-4fcde74f2e51"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:04:32.733541 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:32.739880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:32.740372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:32.740802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:32.741485 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:32.741941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:32.743087 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:33.014680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44a0e553-c201-481e-a0d8-ae32b651604a tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "POST /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287967 Sep 12 12:04:33.015314 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 644/1288] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:04:32 2022] POST /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:41.612014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:41.614169 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:41.616689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:41.617498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:04:41.623145 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.623629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.624062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.624746 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.625199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.625625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.656675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-839cd3e3-21ac-4e1b-ba4a-6cab753a93c4 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048596 Sep 12 12:04:41.657224 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 645/1289] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:04:41 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:41.799535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:41.800071 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:41.806118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.806634 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.807149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.807839 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.808295 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.808723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.837763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-774a228f-4dd3-4786-8659-65e6875da718 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34" status: 200 len: 194 microversion: 2.1 time: 0.043163 Sep 12 12:04:41.839312 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 645/1290] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 12 12:04:41 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:41.850243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:41.850836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:41.856745 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.857227 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.857664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.858346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:41.858823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:41.859251 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:41.939323 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lazy-loading 'services' on Instance uuid e6165a80-b710-4577-ba2b-f6e17e375702 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:04:42.013410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4e22e2d-d203-49f7-92a2-abb7e35b00f0 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34" status: 202 len: 0 microversion: 2.1 time: 0.166879 Sep 12 12:04:42.014082 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 646/1291] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:04:41 2022] DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/14e99b9f-6cb3-4e18-ad3a-f50f87ec7a34 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:04:44.195575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:44.196200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:44.202722 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:44.203209 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:44.203650 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:44.204344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:44.204799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:44.205229 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:44.234965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b10db23-1bad-4702-a896-5414fc56fe65 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/26fec6bd-4006-4a4e-9202-4fcde74f2e51" status: 200 len: 194 microversion: 2.1 time: 0.043367 Sep 12 12:04:44.235569 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 646/1292] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 12 12:04:44 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/26fec6bd-4006-4a4e-9202-4fcde74f2e51 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:04:44.247005 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:44.247580 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:44.253623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:44.254097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:44.254541 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:44.255236 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:44.255700 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:44.256118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:44.337061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lazy-loading 'services' on Instance uuid e6165a80-b710-4577-ba2b-f6e17e375702 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:04:44.407484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-98be5277-095d-496b-b79a-ab781a6c2c8d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/26fec6bd-4006-4a4e-9202-4fcde74f2e51" status: 202 len: 0 microversion: 2.1 time: 0.165085 Sep 12 12:04:44.408110 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 647/1293] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:04:44 2022] DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments/26fec6bd-4006-4a4e-9202-4fcde74f2e51 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:04:45.577277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:45.579610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:45.585858 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.586347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.587523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.587986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.588425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.617725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9dfe55da-e1fa-4f3f-abb9-07ef7506165e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045137 Sep 12 12:04:45.618281 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 647/1294] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:04:45 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:04:45.732452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:45.734808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:45.740900 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.741398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.741813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.742501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.742984 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.743413 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.772665 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b71968d5-97ac-4629-8b43-b1dec971b7fb tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045148 Sep 12 12:04:45.773208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 648/1295] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:04:45 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:04:45.837494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:45.837991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:45.844144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.844624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.845067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.845756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.846214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.846681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.871450 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:04:45.946094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d794517-9ba6-417f-87a6-c4efa335a979 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 204 len: 0 microversion: 2.1 time: 0.111945 Sep 12 12:04:45.947000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 648/1296] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:04:45 2022] DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 12:04:45.955696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:45.956312 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:45.962203 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.962723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.963164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:45.964160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:45.964824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:45.965257 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:46.094215 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:46.101895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-046d41a7-2687-4672-87c1-e766a051349d tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1674 microversion: 2.1 time: 0.150150 Sep 12 12:04:46.102472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 649/1297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:45 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:47.126249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:47.126977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:47.133237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:47.133743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:47.134173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:47.134885 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:47.135339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:47.135927 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:47.274359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:47.282475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e0a0111-9aea-4703-9795-5dcd5ba93731 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1674 microversion: 2.1 time: 0.160475 Sep 12 12:04:47.283063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 649/1298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:47 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:48.305991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:48.306622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:48.313824 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:48.314301 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:48.314814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:48.315502 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:48.315956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:48.316381 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:48.448899 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:48.456544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c1046b2a-fa02-4d36-b84a-d5b2c5f00ddc tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1674 microversion: 2.1 time: 0.154438 Sep 12 12:04:48.457105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 650/1299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:48 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:49.480083 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:49.480774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:49.487355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:49.487837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:49.488286 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:49.489044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:49.489508 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:49.489944 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:49.568558 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e5bc69062549e5bebb5b33e1be492e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a7ef82545435fa36586761e3c85c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:04:49.579813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b47929b-cfea-499a-9df5-ff76542a7639 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 200 len: 1606 microversion: 2.1 time: 0.103861 Sep 12 12:04:49.581104 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 650/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:49 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:04:49.630325 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6165a80-b710-4577-ba2b-f6e17e375702", "name": "network-vif-deleted", "tag": "8171c3fb-1ad0-440a-99c4-49bd90110272"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:04:49.641014 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:49.641781 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:49.642377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:49.655561 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] Creating event network-vif-deleted:8171c3fb-1ad0-440a-99c4-49bd90110272 for instance e6165a80-b710-4577-ba2b-f6e17e375702 on hv-cinder-85331 Sep 12 12:04:49.660671 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-bb1d71f2-2bfe-40b0-8808-4d4054121ed2 req-7d2ef580-5a87-4962-9b97-9d7bf30e56f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114237 Sep 12 12:04:49.661453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 651/1301] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:04:50.608328 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:50.608969 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:50.615351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:50.615818 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:50.616253 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:50.616937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:50.617387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:50.617811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:50.630941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 HTTP/1.1 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:04:50.632559 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:50.634255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'e6165a80-b710-4577-ba2b-f6e17e375702'} Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:04:50.635267 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:50.637640 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:50.639099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:04:50.639099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3abe1160-654b-4e42-b092-438fc9d72e75 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 404 len: 111 microversion: 2.1 time: 0.029574 Sep 12 12:04:50.639099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 651/1302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:50 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:04:50.644485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-674757b3-9f4e-45b9-977d-1b8592c873ab tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '.version_select at 0x7fc93a44a280>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:50.662996 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-674757b3-9f4e-45b9-977d-1b8592c873ab tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964907371" status: 202 len: 0 microversion: 2.1 time: 0.023000 Sep 12 12:04:50.663481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 652/1303] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 12 12:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964907371 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:04:53.570644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:53.571144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:53.577655 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:53.578160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:53.578629 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:53.579347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:53.579798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:53.580222 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:53.596598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 HTTP/1.1 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:04:53.598139 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.599783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'e6165a80-b710-4577-ba2b-f6e17e375702'} Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:04:53.600612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.602098 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.603608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:04:53.603608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c324e643-cf19-49a8-bf20-79778a9de99e tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 404 len: 111 microversion: 2.1 time: 0.032987 Sep 12 12:04:53.603608 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 652/1304] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:04:53 2022] DELETE /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:04:53.609298 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:53.610081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: e6165a80-b710-4577-ba2b-f6e17e375702] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:53.616723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:53.617202 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:53.617634 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:53.618314 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:53.618790 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:53.619213 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:53.632856 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 HTTP/1.1 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:04:53.634453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.636039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'e6165a80-b710-4577-ba2b-f6e17e375702'} Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:04:53.637035 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. Sep 12 12:04:53.638554 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:53.639891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance e6165a80-b710-4577-ba2b-f6e17e375702 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:04:53.639891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-232da224-a0f3-4b5c-8c3b-2b60366e9484 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702" status: 404 len: 111 microversion: 2.1 time: 0.031518 Sep 12 12:04:53.639891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 653/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:53 2022] GET /compute/v2.1/servers/e6165a80-b710-4577-ba2b-f6e17e375702 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:04:54.774039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:54.774579 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:54.781402 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:54.781876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:54.782306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:54.783006 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:54.783457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:54.783884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:54.797763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc HTTP/1.1 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:04:54.799319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.800960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '7bff9ca9-92fa-4ad9-867f-4f889d1261bc'} Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:04:54.801883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.803468 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.805085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:04:54.805085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61a7cae0-f835-447e-8f6f-7ff1948c930f tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 404 len: 111 microversion: 2.1 time: 0.030481 Sep 12 12:04:54.805085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 653/1306] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:04:54 2022] DELETE /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:04:54.809260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:04:54.809905 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] [instance: 7bff9ca9-92fa-4ad9-867f-4f889d1261bc] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:04:54.816588 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:54.817066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:54.817503 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:54.818184 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:04:54.818662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:04:54.819089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:04:54.832190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] HTTP exception thrown: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Request method failure captured: Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc HTTP/1.1 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx49RXmduB962sN8UOMavRZD52KR8r7T2PumzFy09ID831z1hQmXWg_U-uxDqSNyh4OSdNRop8iye5-9HR0eUjGQ92T2eOJJ0vgjpF8Wy8UWOk_piXtTbDG10czRNr9TEFXgJef7J_ae2SmIt9dZlB2Sa-Z2DadSY6pEPJoTBAOhAhQ Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:04:54.833805 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6e8a7ef82545435fa36586761e3c85c3"}]}] Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6e8a7ef82545435fa36586761e3c85c3 Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386705199 Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 16e5bc69062549e5bebb5b33e1be492e Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-1386705199-project Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.835492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '7bff9ca9-92fa-4ad9-867f-4f889d1261bc'} Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:04:54.836375 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. Sep 12 12:04:54.837906 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:04:54.839811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] Returning 404 to user: Instance 7bff9ca9-92fa-4ad9-867f-4f889d1261bc could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:04:54.839811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3f996902-278b-4c6c-a419-ddfa436b2f58 tempest-AttachVolumeTestJSON-1386705199 tempest-AttachVolumeTestJSON-1386705199-project] 10.222.0.15 "GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc" status: 404 len: 111 microversion: 2.1 time: 0.030057 Sep 12 12:04:54.839811 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 654/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:04:54 2022] GET /compute/v2.1/servers/7bff9ca9-92fa-4ad9-867f-4f889d1261bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 12:05:00.263565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:00.265837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:00.272902 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.273515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.273977 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.274700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.275151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.275761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.308203 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7851a39f-71c1-4e38-afd3-4cb6b8613fb9 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048670 Sep 12 12:05:00.309265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 654/1308] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 12 12:05:00 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:00.378482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:00.379151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:00.390230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.390756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.391193 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.391894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.392348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.392774 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.421030 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:05:00.498196 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-11d7bfa3-c1ae-4bf0-a233-501b29fc1c46 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 204 len: 0 microversion: 2.20 time: 0.123879 Sep 12 12:05:00.499036 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 655/1309] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 12 12:05:00 2022] DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 12:05:00.508813 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:00.509426 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:00.516163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.516656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.517096 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.517792 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:00.518249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:00.518764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:00.666091 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:00.674619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:00.676396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:00.678215 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7851d7d6-5aa2-4b0e-b65e-6e1f9b49ffa8 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.174585 Sep 12 12:05:00.678814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 655/1310] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:00 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:05:01.706970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:01.707765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:01.714208 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:01.714720 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:01.715151 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:01.715962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:01.716462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:01.716922 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:01.896710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:01.905454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:01.906942 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:01.908103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8587dd9c-c10c-47a1-9406-27ba8c04ab99 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.205616 Sep 12 12:05:01.908675 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 656/1311] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:01 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 12:05:02.935697 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:02.937179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:02.941064 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:02.947445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:02.948395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:02.948755 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:02.949790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:02.950417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:02.950862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:02.954160 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:03.185738 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:03.194834 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:03.197030 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:03.198201 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71c1f2ca-be1b-46f4-9119-aa9ef055880b tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1724 microversion: 2.20 time: 0.267662 Sep 12 12:05:03.198778 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 656/1312] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:02 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:05:03.856757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873cc9f8-eafa-40df-8e7e-34277921befb", "name": "network-vif-deleted", "tag": "059cf3cb-438a-4a55-bdc6-86ba75da46f0"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:03.867931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:03.868619 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:03.869230 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:03.882345 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] Creating event network-vif-deleted:059cf3cb-438a-4a55-bdc6-86ba75da46f0 for instance 873cc9f8-eafa-40df-8e7e-34277921befb on hv-cinder-85331 Sep 12 12:05:03.889681 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-8b2b0ce3-0ead-448d-bc46-fbefd4719f19 req-b9d5e5ae-f76c-44e3-b4b2-fe7f2a6609c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Sep 12 12:05:03.890797 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 657/1313] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:05:03.954212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:03.955542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:03.964993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:03.966604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:03.967242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:03.968323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:03.968952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:03.969536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:04.016458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b88f86a-699f-40fd-b8db-39fef6126859 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/ips" status: 200 len: 149 microversion: 2.1 time: 0.068439 Sep 12 12:05:04.024289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 657/1314] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:05:03 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/ips => generated 149 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:05:04.228346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:04.229444 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:04.241908 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:04.242437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:04.242963 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:04.244597 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:04.246727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:04.247931 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:04.312066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:04.313206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:04.313935 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:04.314409 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lazy-loading 'fault' on Instance uuid 873cc9f8-eafa-40df-8e7e-34277921befb {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:05:04.370427 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:04.379793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:04.382162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3c1f7f6f8649a991d5d8a15eb8826b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0356e6690066437a86fc69833ff4cb69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:04.383537 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed96dc9f-4b8e-4e30-8acc-677c86b3aeee tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 200 len: 1371 microversion: 2.20 time: 0.161021 Sep 12 12:05:04.384595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 658/1315] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:04 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 12:05:05.409623 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:05.410248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:05.417325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:05.417880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:05.418388 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:05.419931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:05.420501 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:05.420995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:05.435724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb HTTP/1.1 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:05.436465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:05.438566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '873cc9f8-eafa-40df-8e7e-34277921befb'} Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:05.439893 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:05.441526 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:05.445063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:05.445063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e82eb974-db50-4f76-aa3a-0b85b055fe81 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 404 len: 111 microversion: 2.20 time: 0.032261 Sep 12 12:05:05.445063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 658/1316] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:05 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:05:05.446968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3c29abf-ae92-49ea-9e93-57049981628d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '.version_select at 0x7fc93a490280>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:05.466131 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a3c29abf-ae92-49ea-9e93-57049981628d tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975825599" status: 204 len: 0 microversion: 2.20 time: 0.022337 Sep 12 12:05:05.466842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 659/1317] 10.222.0.15 () {60 vars in 1259 bytes} [Mon Sep 12 12:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975825599 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 12:05:05.533798 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b650cec-6b65-49d6-8755-cad2bbbda7a0"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:05.536266 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:05.542432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:05.543269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:05.544886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:05.545417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:05.545984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:05.546483 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:05.856142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef8fa1d3-4226-4587-b06a-3145fbe47df4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "POST /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326873 Sep 12 12:05:05.857145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 659/1318] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:05:05 2022] POST /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:05:07.327386 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:07.327868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:07.334834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:07.335315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:07.335747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:07.336434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:07.336878 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:07.337295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:07.351479 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb HTTP/1.1 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:07.353189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.358544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '873cc9f8-eafa-40df-8e7e-34277921befb'} Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:07.359592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.361115 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.362660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:07.362660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2af1dc4e-2d72-4204-a3fb-5082d2fe7585 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 404 len: 111 microversion: 2.20 time: 0.032191 Sep 12 12:05:07.362660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 660/1319] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 12 12:05:07 2022] DELETE /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 12 12:05:07.364276 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:07.365004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: 873cc9f8-eafa-40df-8e7e-34277921befb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:07.371242 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:07.371729 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:07.372172 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:07.372865 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:07.373317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:07.373743 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:07.393586 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb HTTP/1.1 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:07.395615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.397417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '873cc9f8-eafa-40df-8e7e-34277921befb'} Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:07.398372 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. Sep 12 12:05:07.399919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:07.401446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance 873cc9f8-eafa-40df-8e7e-34277921befb could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:07.401446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be5da033-437a-4078-b4e7-2395abab0cb3 tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb" status: 404 len: 111 microversion: 2.20 time: 0.037520 Sep 12 12:05:07.401446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 660/1320] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:07 2022] GET /compute/v2.1/servers/873cc9f8-eafa-40df-8e7e-34277921befb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:05:08.548320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:08.548852 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:08.555318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:08.555799 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:08.556237 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:08.556929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:08.557387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:08.557835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:08.571885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 HTTP/1.1 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:08.573475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.575845 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'c07bfce9-613c-4147-b9c2-47f2ad345dc9'} Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:08.577057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.578949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.580493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:08.580493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0e09293-0211-42e5-a399-aab24775b8ea tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 404 len: 111 microversion: 2.20 time: 0.031014 Sep 12 12:05:08.580493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 661/1321] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 12 12:05:08 2022] DELETE /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 12 12:05:08.584254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:08.584869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] [instance: c07bfce9-613c-4147-b9c2-47f2ad345dc9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:08.592079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:08.592564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:08.593004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:08.593733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:08.594200 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:08.594656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:08.608397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] HTTP exception thrown: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Request method failure captured: Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 HTTP/1.1 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2lfKczJT6xt0Vhxh5QuSqrnT7fV6gMYpK8qRdwZ2jurl5Mgr9c9c_m1l9Osre9umNf3VQVGaiHCRd8HFyCZ6tzyPp3hsy62ZdYlL5TS3ta2xeecQLkqBGh0C33of0UewukM0zUilhuQXFpySDGFSZj3YRtFvAvhLhua2aB8nbqNXg Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:08.609908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0356e6690066437a86fc69833ff4cb69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0356e6690066437a86fc69833ff4cb69"}]}] Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0356e6690066437a86fc69833ff4cb69 Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682191654 Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 6e3c1f7f6f8649a991d5d8a15eb8826b Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682191654-project Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.611628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'c07bfce9-613c-4147-b9c2-47f2ad345dc9'} Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:08.612734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. Sep 12 12:05:08.614311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:08.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] Returning 404 to user: Instance c07bfce9-613c-4147-b9c2-47f2ad345dc9 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:08.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-410381db-b0c1-42fb-a2ca-7f82a1f2724c tempest-AttachVolumeShelveTestJSON-682191654 tempest-AttachVolumeShelveTestJSON-682191654-project] 10.222.0.15 "GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9" status: 404 len: 111 microversion: 2.20 time: 0.031231 Sep 12 12:05:08.615799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 661/1322] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 12 12:05:08 2022] GET /compute/v2.1/servers/c07bfce9-613c-4147-b9c2-47f2ad345dc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:05:12.990994 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7484abd8-777e-45ae-9b79-3dd2d0b389da tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Action: 'create', calling method: .version_select at 0x7fc93a5a6940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-509915054", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7484abd8-777e-45ae-9b79-3dd2d0b389da tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 121 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:12.996390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-509915054", "metadata": {"Type": "work"}}} Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: Sep 12 12:05:12.998725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-509915054', 'metadata': {'Type': 'work'}}}} Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise error Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi '#$%' Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:12.999725 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 12:05:13.001380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 12:05:13.002741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 12:05:13.002741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.002741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7484abd8-777e-45ae-9b79-3dd2d0b389da tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.002741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7484abd8-777e-45ae-9b79-3dd2d0b389da tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128649 Sep 12 12:05:13.002741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 662/1323] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 12 12:05:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 12 12:05:13.009991 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aee03f4-78f5-44b9-92a6-1f1fa153df8c tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Action: 'create', calling method: .version_select at 0x7fc93a5cbca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577951770", "metadata": {"Type": "work"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aee03f4-78f5-44b9-92a6-1f1fa153df8c tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 119 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:13.015718 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577951770", "metadata": {"Type": "work"}}} Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 12:05:13.017421 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-577951770', 'metadata': {'Type': 'work'}}}} Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '0' Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:13.018601 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 12:05:13.020212 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 12:05:13.024455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 12:05:13.024455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.024455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aee03f4-78f5-44b9-92a6-1f1fa153df8c tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.024455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7aee03f4-78f5-44b9-92a6-1f1fa153df8c tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012523 Sep 12 12:05:13.024455 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 662/1324] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 12 12:05:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 12:05:13.029843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0214b4d7-7af6-4f02-8067-76dee038d8a5 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Action: 'create', calling method: .version_select at 0x7fc93a469310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1550964251", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0214b4d7-7af6-4f02-8067-76dee038d8a5 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 119 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:13.034497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1550964251", "metadata": {"Type": "work"}}} Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: Sep 12 12:05:13.036311 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1550964251', 'metadata': {'Type': 'work'}}}} Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise error Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi '' Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:13.037612 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 12:05:13.039481 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 12:05:13.040964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 12:05:13.040964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.040964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0214b4d7-7af6-4f02-8067-76dee038d8a5 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.040964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0214b4d7-7af6-4f02-8067-76dee038d8a5 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012035 Sep 12 12:05:13.040964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 663/1325] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 12 12:05:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 12 12:05:13.047507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00c4b954-8d16-45b4-ad75-54e7630ec4c1 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Calling method '.version_select at 0x7fc93dc2f940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:13.079808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-00c4b954-8d16-45b4-ad75-54e7630ec4c1 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] HTTP exception thrown: Volume tempest-invalid-1894082582 could not be found. Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00c4b954-8d16-45b4-ad75-54e7630ec4c1 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1894082582 HTTP/1.1 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:13.081805 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Volume tempest-invalid-1894082582 could not be found. Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'tempest-invalid-1894082582'} Sep 12 12:05:13.083488 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1894082582 could not be found. (HTTP 404) (Request-ID: req-8160c905-f3fe-4364-a096-b822e25bc0db) Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.086068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 12:05:13.087498 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1894082582 could not be found. Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:13.088847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1894082582 could not be found. Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1894082582 could not be found. Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00c4b954-8d16-45b4-ad75-54e7630ec4c1 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 404 to user: Volume tempest-invalid-1894082582 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00c4b954-8d16-45b4-ad75-54e7630ec4c1 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1894082582" status: 404 len: 99 microversion: 2.1 time: 0.040714 Sep 12 12:05:13.090332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 663/1326] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 12 12:05:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1894082582 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 12 12:05:13.093474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-133327d6-375d-4bb9-88ca-98f14d4c0553 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004047 Sep 12 12:05:13.094129 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 664/1327] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Sep 12 12:05:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 12:05:13.102936 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23dc6d83-4187-4bf7-a77e-85d07bc8bd18 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003850 Sep 12 12:05:13.103457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 664/1328] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Sep 12 12:05:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 12 12:05:13.113528 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-862335ee-8c4f-49b2-b9ef-1f02ef201d61 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Calling method '.version_select at 0x7fc93a7ac430>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:13.143647 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-862335ee-8c4f-49b2-b9ef-1f02ef201d61 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] HTTP exception thrown: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-862335ee-8c4f-49b2-b9ef-1f02ef201d61 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/os-volumes/dd4dfde3-26d2-4bcf-a91b-7d51650000cb HTTP/1.1 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:13.145696 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'dd4dfde3-26d2-4bcf-a91b-7d51650000cb'} Sep 12 12:05:13.147172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. (HTTP 404) (Request-ID: req-7a9c948f-9c2f-4077-84ca-0b78f7ddad6e) Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.151197 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 12:05:13.152643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 12:05:13.155482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-862335ee-8c4f-49b2-b9ef-1f02ef201d61 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 404 to user: Volume dd4dfde3-26d2-4bcf-a91b-7d51650000cb could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-862335ee-8c4f-49b2-b9ef-1f02ef201d61 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/dd4dfde3-26d2-4bcf-a91b-7d51650000cb" status: 404 len: 109 microversion: 2.1 time: 0.037944 Sep 12 12:05:13.156927 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 665/1329] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 12 12:05:13 2022] DELETE /compute/v2.1/os-volumes/dd4dfde3-26d2-4bcf-a91b-7d51650000cb => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:13.158026 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7c8b0e7-f5ae-4f54-9ab4-ef4328476ae7 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Calling method '.version_select at 0x7fc93dc30160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:13.184905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b7c8b0e7-f5ae-4f54-9ab4-ef4328476ae7 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] HTTP exception thrown: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7c8b0e7-f5ae-4f54-9ab4-ef4328476ae7 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Request method failure captured: Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/e3488a27-4de5-47b3-bfaa-c1606332f8fd HTTP/1.1 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHyB4KNWAQVJRpf3jXFRxGKogRaSM7CT2citmsa3e8wosD2M7bOoNvxtoH_lZZNLmQ0Xd_0-3f4EjOtQ70K8SgtiOrPAMM8Qj5NjcJkqHihtu2ycYBQxPqmumQkULVE1byqtJX3Zun3rpgm_GzwIoT8ZJDys2iBVkBHz5jNl6Fj0Cnv0 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:13.187037 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d268e52a2f44076aa085841de8bc70d"}]}] Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 0d268e52a2f44076aa085841de8bc70d Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-858697946 Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 9bc7f6a21901446c8063116cfaf6f1fb Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-858697946-project Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'e3488a27-4de5-47b3-bfaa-c1606332f8fd'} Sep 12 12:05:13.188987 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. (HTTP 404) (Request-ID: req-61235438-5b01-4e4a-9128-7c79d505a415) Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.189886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 12:05:13.191185 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 12:05:13.192367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7c8b0e7-f5ae-4f54-9ab4-ef4328476ae7 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] Returning 404 to user: Volume e3488a27-4de5-47b3-bfaa-c1606332f8fd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7c8b0e7-f5ae-4f54-9ab4-ef4328476ae7 tempest-VolumesNegativeTest-858697946 tempest-VolumesNegativeTest-858697946-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e3488a27-4de5-47b3-bfaa-c1606332f8fd" status: 404 len: 109 microversion: 2.1 time: 0.035279 Sep 12 12:05:13.193649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 665/1330] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 12 12:05:13 2022] GET /compute/v2.1/os-volumes/e3488a27-4de5-47b3-bfaa-c1606332f8fd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:13.581910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:13.585464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:13.588493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:13.592726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:13.593210 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:13.593648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:13.594349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:13.594904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:13.595329 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:13.598915 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:13.702794 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lazy-loading 'services' on Instance uuid 40359b1b-18bb-492f-b711-066921ccbd1c {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:05:13.782168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8e32e68f-c929-4d2d-b7a7-85b76369e055 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments/9b650cec-6b65-49d6-8755-cad2bbbda7a0" status: 202 len: 0 microversion: 2.1 time: 0.203990 Sep 12 12:05:13.782891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 666/1331] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:05:13 2022] DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments/9b650cec-6b65-49d6-8755-cad2bbbda7a0 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:05:13.793554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:13.796598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:13.803962 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:13.804457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:13.804895 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:13.805772 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:13.806237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:13.806709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:13.844127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6801df77-076a-4fd3-93bd-e2ecc6e2a2f6 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055795 Sep 12 12:05:13.844758 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 666/1332] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:05:13 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:05:14.859455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:14.862710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:14.869229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:14.869973 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:14.870601 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:14.871306 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:14.871921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:14.872358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:14.905272 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4c9ff53-64af-4ab8-a866-7b3af7467de9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052066 Sep 12 12:05:14.905816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 667/1333] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:05:14 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:05:14.974022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:14.974604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:14.981477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:14.982017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:14.982780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:14.983479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:14.984110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:14.984919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:15.012180 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:05:15.098796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e0cea8d-41c6-4f9d-a834-fe71ae36d5d0 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 204 len: 0 microversion: 2.1 time: 0.128570 Sep 12 12:05:15.099843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 667/1334] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:05:14 2022] DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:05:15.108843 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:15.109782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:15.116472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:15.117457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:15.117664 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:15.118346 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:15.118830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:15.119294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:15.266698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:15.275056 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea613e96-797b-4fef-aea7-923128e9dbb7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1682 microversion: 2.1 time: 0.170836 Sep 12 12:05:15.276050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 668/1335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:15 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:16.303726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:16.304427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:16.310872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:16.311554 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:16.311810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:16.312487 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:16.312950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:16.313384 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:16.449387 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:16.458025 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dca22229-5af7-43d7-9c1f-084ea8f2642c tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1682 microversion: 2.1 time: 0.158476 Sep 12 12:05:16.458694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 668/1336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:16 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:17.481267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:17.481872 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:17.488302 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:17.488778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:17.489206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:17.489909 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:17.490357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:17.490803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:17.623095 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:17.631187 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f3dc65e3-6eaf-4173-a4d1-be19f60bd281 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1682 microversion: 2.1 time: 0.153863 Sep 12 12:05:17.631757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 669/1337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:17 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:18.624044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40359b1b-18bb-492f-b711-066921ccbd1c", "name": "network-vif-deleted", "tag": "2848a8ee-8fa8-467e-947d-53639185ac2d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:18.636680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:18.637306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:18.637824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:18.651164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] Creating event network-vif-deleted:2848a8ee-8fa8-467e-947d-53639185ac2d for instance 40359b1b-18bb-492f-b711-066921ccbd1c on hv-cinder-85331 Sep 12 12:05:18.656932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:18.657578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8a965e88-5145-4a6d-b3ed-a16120b71258 req-6c540352-9b85-41de-9e25-8757bddb969c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038632 Sep 12 12:05:18.658270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 669/1338] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:05:18.658704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:18.666448 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:18.667016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:18.667456 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:18.668157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:18.668613 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:18.669058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:18.749624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58a59c389cf4b3198a6c452eb2772d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7225740627444e3a97ff730460c52e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:18.761090 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cb79298f-5039-47cc-ab5f-d86d296e93f4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 200 len: 1327 microversion: 2.1 time: 0.109108 Sep 12 12:05:18.762243 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 670/1339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:18 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:19.785639 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:19.786337 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:19.793233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:19.793728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:19.794157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:19.795480 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:19.796009 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:19.796469 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:19.809475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c HTTP/1.1 Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:19.811124 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:19.812801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '40359b1b-18bb-492f-b711-066921ccbd1c'} Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:19.813773 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:19.815598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:19.816971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:19.816971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b221a5e0-e1a6-490f-a014-3683213ed98e tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 404 len: 111 microversion: 2.1 time: 0.031137 Sep 12 12:05:19.816971 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 670/1340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:19 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 12:05:19.821571 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-28e02326-ed33-4c38-b67f-8407995932a4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '.version_select at 0x7fc93a490310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:19.843217 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-28e02326-ed33-4c38-b67f-8407995932a4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911532086" status: 202 len: 0 microversion: 2.1 time: 0.025357 Sep 12 12:05:19.843783 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 671/1341] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 12 12:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911532086 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:05:27.957186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:27.957724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:27.964118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:27.964594 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:27.965033 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:27.965716 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:27.966174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:27.966615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:27.979740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c HTTP/1.1 Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:27.981251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:27.983068 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '40359b1b-18bb-492f-b711-066921ccbd1c'} Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:27.984179 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:27.986017 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:27.987687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:27.987687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-669ddaa9-bce5-4fa9-bd61-169ecb072b69 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 404 len: 111 microversion: 2.1 time: 0.029281 Sep 12 12:05:27.987687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 671/1342] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:05:27 2022] DELETE /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:27.991823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:27.992435 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 40359b1b-18bb-492f-b711-066921ccbd1c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:27.999566 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:28.000045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:28.000480 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:28.001162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:28.001614 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:28.002037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:28.015486 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c HTTP/1.1 Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:28.017149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:28.018871 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '40359b1b-18bb-492f-b711-066921ccbd1c'} Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:28.020103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. Sep 12 12:05:28.021749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:28.023260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 40359b1b-18bb-492f-b711-066921ccbd1c could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:28.023260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f577cd22-41e9-486f-9cef-e22d02ae72f8 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c" status: 404 len: 111 microversion: 2.1 time: 0.031353 Sep 12 12:05:28.023260 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 672/1343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:27 2022] GET /compute/v2.1/servers/40359b1b-18bb-492f-b711-066921ccbd1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:29.280596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:29.281085 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:29.287391 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.287868 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.288297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.288972 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.289420 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.289846 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.302775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec HTTP/1.1 Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:29.304290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.305942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'f66e13ac-f5d7-4903-afbd-8a6059142cec'} Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:29.306964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.308519 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.310126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:29.310126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70082119-8499-4bca-9815-fe538bf2822d tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 404 len: 111 microversion: 2.1 time: 0.028904 Sep 12 12:05:29.310126 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 672/1344] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:05:29 2022] DELETE /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:29.314532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:29.315295 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: f66e13ac-f5d7-4903-afbd-8a6059142cec] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:29.321686 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.322162 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.322615 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.323293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.323742 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.324159 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.337762 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec HTTP/1.1 Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:29.339279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.340923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'f66e13ac-f5d7-4903-afbd-8a6059142cec'} Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:29.341932 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. Sep 12 12:05:29.343449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.344796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance f66e13ac-f5d7-4903-afbd-8a6059142cec could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:29.344796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f70b75a1-57fe-4f1d-9b21-92b5145a68f9 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec" status: 404 len: 111 microversion: 2.1 time: 0.030477 Sep 12 12:05:29.344796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 673/1345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:29 2022] GET /compute/v2.1/servers/f66e13ac-f5d7-4903-afbd-8a6059142cec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:29.349191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:29.349691 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:29.355566 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.356043 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.356481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.357162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.357612 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.358039 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.373467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf HTTP/1.1 Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:29.375397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.377051 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '8b230ba8-8256-43a9-ba1d-bd1167fd36bf'} Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:29.377886 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.379807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.381245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:29.381245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa240810-e9f4-4090-b084-9a03498c43be tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 404 len: 111 microversion: 2.1 time: 0.031482 Sep 12 12:05:29.381245 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 673/1346] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:05:29 2022] DELETE /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:29.385699 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:29.386316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 8b230ba8-8256-43a9-ba1d-bd1167fd36bf] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:29.392816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.393294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.393732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.394411 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:29.394897 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:29.395321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:29.410166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf HTTP/1.1 Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:29.411701 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.413332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '8b230ba8-8256-43a9-ba1d-bd1167fd36bf'} Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:29.414249 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. Sep 12 12:05:29.415782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:29.417135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 8b230ba8-8256-43a9-ba1d-bd1167fd36bf could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:29.417135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7eb46005-6a16-40f1-9b6d-9b58a1642ec4 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf" status: 404 len: 111 microversion: 2.1 time: 0.031448 Sep 12 12:05:29.417135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 674/1347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:29 2022] GET /compute/v2.1/servers/8b230ba8-8256-43a9-ba1d-bd1167fd36bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:30.555268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:30.555744 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:30.562457 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:30.563174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:30.563610 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:30.564331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:30.564807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:30.565425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:30.580823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab HTTP/1.1 Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:05:30.582671 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.584405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '1e2d709d-f003-488e-9bb0-bfb75d0f69ab'} Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:30.585287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.586829 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.589162 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:30.590148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6368305-c5e8-40ec-953e-2a3238371c63 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 404 len: 111 microversion: 2.1 time: 0.038885 Sep 12 12:05:30.590926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 674/1348] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:05:30 2022] DELETE /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:30.599559 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:30.600173 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] [instance: 1e2d709d-f003-488e-9bb0-bfb75d0f69ab] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:30.606412 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:30.606923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:30.607355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:30.608039 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:30.608492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:30.608916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:30.623902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] HTTP exception thrown: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Request method failure captured: Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab HTTP/1.1 Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx2sMpdfo0A26iqOyBAKQ5563gNsdXOCVQe2Bp-llOjW3QgxF0cltO_PkeOuRlPeZY8rZvu38Xg4ChbktOmBcmhpP-mVVIthu_N6jTEDG04Vq-8ellZUo0PEpOWL8cag3Jpt4YohuP8PU_UYufWKDjRKir6JdDr4-yJU91rBu--NPgk Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:05:30.625956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7225740627444e3a97ff730460c52e7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7225740627444e3a97ff730460c52e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7225740627444e3a97ff730460c52e7d"}]}] Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 7225740627444e3a97ff730460c52e7d Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066202183 Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: f58a59c389cf4b3198a6c452eb2772d6 Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-1066202183-project Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.627457 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '1e2d709d-f003-488e-9bb0-bfb75d0f69ab'} Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:05:30.628396 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. Sep 12 12:05:30.629972 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:05:30.631713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] Returning 404 to user: Instance 1e2d709d-f003-488e-9bb0-bfb75d0f69ab could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:05:30.631713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-60906d91-0c26-4869-a9b5-5dabea96e0e7 tempest-AttachVolumeNegativeTest-1066202183 tempest-AttachVolumeNegativeTest-1066202183-project] 10.222.0.15 "GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab" status: 404 len: 111 microversion: 2.1 time: 0.031610 Sep 12 12:05:30.631713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 675/1349] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:30 2022] GET /compute/v2.1/servers/1e2d709d-f003-488e-9bb0-bfb75d0f69ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:05:55.814434 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:05:55.814994 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:55.819396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:55.820707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:55.828252 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:55.828821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:55.829340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:55.830116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:55.830681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:55.831224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:55.858968 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lazy-loading 'flavor' on Instance uuid db999bf5-0139-4955-a55e-c112a4c88ff5 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:05:55.932379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4ab6317-ae61-4f7b-8d6a-f2ec82e4a340 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "POST /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5/action" status: 202 len: 0 microversion: 2.1 time: 0.123659 Sep 12 12:05:55.932995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 675/1350] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:05:55 2022] POST /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:05:55.942414 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:55.943818 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:55.948293 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 12:05:55.948498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Mon Sep 12 12:05:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 (ip 10.222.0.15) !!! Sep 12 12:05:55.950938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:55.951624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:05:55.965674 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:55.966166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:55.966648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:55.967353 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:55.967823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:55.968313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:56.108233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:56.117190 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-94ed306e-acaa-444a-b44b-d0dbd5276447 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.179787 Sep 12 12:05:56.118026 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 676/1351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:55 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:05:57.142007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:57.142748 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:57.150191 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:57.150730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:57.151176 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:57.151870 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:57.152339 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:57.152771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:57.283024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:57.291706 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8764569d-6c61-418a-a426-810858395e3c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.153908 Sep 12 12:05:57.292283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 676/1352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:57 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:58.314947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:58.315560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:58.322380 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:58.322892 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:58.323331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:58.324016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:58.324468 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:58.324890 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:58.715347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:58.722979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12d45187-5bae-48b0-b697-c871d3e8cb9a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.412009 Sep 12 12:05:58.724322 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 677/1353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:58 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:05:59.746303 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:05:59.746963 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:05:59.753898 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:59.754389 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:59.755453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:59.756175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:05:59.756631 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:05:59.757059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:05:59.910913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:05:59.919165 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf586da4-f5f9-478e-ad7c-06fed1b4965a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.176730 Sep 12 12:05:59.919749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 677/1354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:05:59 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:00.944829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:00.945441 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:00.951570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:00.952054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:00.952491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:00.953177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:00.953632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:00.954060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:01.086033 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:01.093841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-004e92c4-4d59-4f16-90a7-61e4eed5c9db tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.154016 Sep 12 12:06:01.094408 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 678/1355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:00 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:02.116809 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:02.117880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:02.124028 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:02.124513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:02.124951 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:02.125641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:02.126094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:02.126538 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:02.264258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:02.272007 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0466d45a-f6bc-40be-a7f0-c74c90bbc316 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.159421 Sep 12 12:06:02.272576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 678/1356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:02 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:03.295736 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:03.296476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:03.303057 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:03.303624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:03.304180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:03.304877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:03.305358 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:03.305785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:03.450189 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:03.458756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cbe98536-f560-48f7-8878-b33b2ea279d0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.166218 Sep 12 12:06:03.459331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 679/1357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:03 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:04.482285 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:04.482781 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:04.489894 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:04.490412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:04.491435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:04.492799 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:04.493254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:04.493837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:04.637404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:04.645115 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1f4d6dc-d4f5-4af6-83a3-3da46ff20e04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.167349 Sep 12 12:06:04.646254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 679/1358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:04 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:05.668837 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:05.669452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:05.676044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:05.676578 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:05.677170 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:05.678066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:05.678536 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:05.678985 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:05.813916 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:05.822793 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7f8bcb47-e4bd-4ca9-9cb0-255cb5361173 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.158049 Sep 12 12:06:05.823363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 680/1359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:05 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:06.847127 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:06.847820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:06.857052 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:06.857825 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:06.859099 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:06.860880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:06.861775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:06.862692 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:07.014580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:07.022801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50cbf674-11c6-4b65-8dd8-22166f60604c tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.179741 Sep 12 12:06:07.023367 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 680/1360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:06 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:08.046244 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:08.046863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:08.053482 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:08.053954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:08.054383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:08.055103 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:08.055552 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:08.055970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:08.201348 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:08.209066 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f4f43199-a75e-47a1-b20f-84ef2cbccec6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.166764 Sep 12 12:06:08.209622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 681/1361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:08 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:09.232699 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:09.233467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:09.240125 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:09.241086 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:09.241534 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:09.242246 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:09.242810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:09.243261 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:09.377590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:09.386170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afdf1512-94fb-4f23-92e5-660fecead8b6 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.157339 Sep 12 12:06:09.386871 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 681/1362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:09 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:10.410748 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:10.411321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:10.417646 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:10.418124 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:10.418587 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:10.419269 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:10.419723 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:10.420146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:10.553850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:10.561631 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f1303f70-cf52-4010-b914-d8d50b4ffde2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.154903 Sep 12 12:06:10.562226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 682/1363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:10 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:11.585596 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:11.586223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:11.592740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:11.593217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:11.593649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:11.594327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:11.594808 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:11.595234 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:11.728543 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:11.736218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b3e35d6-b83f-4aee-b14d-a4536bc6088f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.155005 Sep 12 12:06:11.736783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 682/1364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:11 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:12.760138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:12.760754 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:12.767111 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:12.767584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:12.768013 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:12.768692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:12.769147 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:12.769565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:12.905363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:12.914335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-99f16171-855f-4ad6-af92-9bf2a692ac30 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.158619 Sep 12 12:06:12.914928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 683/1365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:12 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:13.936913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:13.937495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:13.943869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:13.944359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:13.944867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:13.945823 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:13.946311 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:13.946751 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:14.082867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:14.092490 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ac5a2ce-52e8-4054-a72f-e4a66eee8edb tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.159315 Sep 12 12:06:14.093148 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 683/1366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:13 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:15.116690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:15.117741 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:15.123928 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:15.124511 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:15.124966 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:15.125693 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:15.126194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:15.126688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:15.265976 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:15.274242 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-31f68d86-ce03-485b-a4a6-df0956874cbe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.162314 Sep 12 12:06:15.275037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 684/1367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:15 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:16.297630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:16.298243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:16.306447 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:16.307207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:16.307643 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:16.308340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:16.309353 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:16.309957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:16.457507 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:16.467345 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7122964e-87cb-4fde-98b4-fd26e9f8033f tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.173880 Sep 12 12:06:16.468145 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 684/1368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:16 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:17.491648 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:17.492261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:17.499048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.499533 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.499979 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.500670 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.501128 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.501565 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.640318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:17.648765 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3cf7148f-5574-4fd1-ae7e-f2a2c96eb8ac tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1508 microversion: 2.1 time: 0.161021 Sep 12 12:06:17.649334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 685/1369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:17 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:17.672359 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:17.672959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:17.679793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.680369 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.680878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.681680 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.682263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.682827 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.846834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "name": "network-vif-unplugged", "status": "completed", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:17.859815 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 12:06:17.866327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.866841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.867280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.890107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.compute.server_external_events [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] Unable to find a host for instance db999bf5-0139-4955-a55e-c112a4c88ff5. Dropping event network-vif-unplugged {{(pid=120424) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 12:06:17.891018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a0802112-a581-4d0a-81f2-d795c28db51e req-3abd648a-a8dd-479b-ac10-e76a9fc48022 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048721 Sep 12 12:06:17.901157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 686/1370] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 12 12:06:17.960926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b38192e-99b9-436c-a76d-455dd9647dbc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "POST /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5/action" status: 202 len: 0 microversion: 2.1 time: 0.292279 Sep 12 12:06:17.962249 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 685/1371] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:06:17 2022] POST /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:06:17.970136 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:17.970912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:17.981912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.982673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.983113 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:17.983817 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:17.984271 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:17.984717 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:18.151842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:18.159781 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd88d2a2-c2d6-4884-9258-ed9060f0123d tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1516 microversion: 2.1 time: 0.193585 Sep 12 12:06:18.160389 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 687/1372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:17 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:19.184208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:19.184830 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:19.190851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:19.191330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:19.191814 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:19.192709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:19.193213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:19.194231 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:19.400663 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:19.409563 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bee94aff-dedd-4d19-9aa9-a21aaa4e62e3 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1518 microversion: 2.1 time: 0.230222 Sep 12 12:06:19.410619 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 686/1373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:19 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:20.435875 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:20.436300 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:20.442659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:20.443142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:20.443641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:20.444437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:20.445156 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:20.445938 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:20.629118 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:20.639869 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1b70c70a-aba6-4dd7-bee4-8b26401d8ded tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.208363 Sep 12 12:06:20.640814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 688/1374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:20 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:21.666090 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:21.666767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:21.677747 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:21.680060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:21.685112 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:21.686002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:21.686708 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:21.687370 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:21.865707 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:21.880258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-601ebd57-55b4-4b92-b53c-fbcbf8b7bb21 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.218410 Sep 12 12:06:21.881220 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 687/1375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:21 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:22.907070 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:22.907657 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:22.914864 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:22.915360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:22.915792 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:22.916594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:22.917176 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:22.917484 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:23.161891 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:23.181617 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06250095-9c64-4656-8e1f-8f78a977bf8a tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.279126 Sep 12 12:06:23.183546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 689/1376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:22 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:24.213510 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:24.215004 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:24.234074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:24.235110 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:24.235760 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:24.237319 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:24.238005 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:24.239155 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:24.286282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:24.539188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:24.552604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2bc2956-f7c1-4956-a9ef-fe2919daa2a2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.345640 Sep 12 12:06:24.553446 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 688/1377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:24 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:25.577488 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:25.578107 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:25.588270 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:25.592462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:25.593088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:25.593960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:25.594628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:25.595525 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:25.886241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:25.894290 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e1beb0a9-e348-4b8b-ab0e-952d37604fe2 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.320497 Sep 12 12:06:25.895624 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 690/1378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:25 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:26.601208 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:26.601740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:26.604170 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:26.616908 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:26.617409 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:26.617852 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:26.626644 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:26.631938 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:26.633002 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:26.688213 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:06:26.874728 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1fda43d-cd89-46fc-82b2-a0e04ece32e7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 204 len: 0 microversion: 2.1 time: 0.275643 Sep 12 12:06:26.878561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 689/1379] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:06:26 2022] DELETE /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:06:26.890732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:26.891448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:26.908978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057ebe0-ef52-42be-8192-758b1e62c589", "tag": "6553671d-60e7-4e61-bf1b-d839411b347c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:26.915740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=31 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:26.920872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:26.921379 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:26.921824 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:26.927347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:26.927844 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:26.928764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:26.929357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:26.935662 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:26.936584 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:26.959209 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=87 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:26.966786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] Creating event network-changed:6553671d-60e7-4e61-bf1b-d839411b347c for instance 2057ebe0-ef52-42be-8192-758b1e62c589 on hv-cinder-85331 Sep 12 12:06:26.982833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-5a0102fb-7c86-4d29-be18-351c49e509ca req-5a7ec46a-89f6-44a2-b6e6-ca4102c388ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378135 Sep 12 12:06:26.983538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 691/1380] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:06:26.992225 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:26.992929 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:27.005287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:27.005782 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:27.006253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:27.007710 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:27.008692 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:27.009297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:27.221491 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:27.229622 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:27.232868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0fc7f3c6-0799-4849-adc8-9586e5f67aaa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.245263 Sep 12 12:06:27.233454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 692/1381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:26 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:27.244070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-952c55bf-57af-490e-85e1-f91fd1918a81 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1576 microversion: 2.1 time: 0.364203 Sep 12 12:06:27.247615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 690/1382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:26 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1576 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:28.273946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:28.275262 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:28.276736 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:28.278397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:28.290721 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:28.291595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:28.292831 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:28.293860 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:28.295342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:28.296546 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:28.308348 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:28.308855 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:28.309301 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:28.310053 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:28.310530 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:28.310964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:28.530595 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:28.542007 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be145415-bb5c-464b-8e5a-e86586e839fa tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.273810 Sep 12 12:06:28.560943 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 693/1383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:28 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:28.639835 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:28.652957 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67582791-47d7-4c96-827f-96484af47509 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1576 microversion: 2.1 time: 0.381128 Sep 12 12:06:28.656820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 691/1384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:28 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:29.567747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:29.568405 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:29.581146 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:29.581889 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:29.582098 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:29.582851 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:29.583305 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:29.583740 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:29.687757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:29.689223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:29.718121 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:29.719557 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:29.720248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:29.721218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:29.727494 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:29.728331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:30.236912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:30.246958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-52d9f76b-4fcd-422d-b433-a2a856336af0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.685509 Sep 12 12:06:30.247538 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 694/1385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:29 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:30.470405 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:30.485108 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3c7b325-1b81-4cf6-8b95-648e37adddf5 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1576 microversion: 2.1 time: 0.809844 Sep 12 12:06:30.486774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 692/1386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:29 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1576 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:31.268978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2057ebe0-ef52-42be-8192-758b1e62c589", "name": "network-vif-deleted", "tag": "6553671d-60e7-4e61-bf1b-d839411b347c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:31.273330 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:31.274630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:31.298360 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:31.299606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:31.300806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:31.301475 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:31.303196 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:31.304654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:31.311686 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:31.312404 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:31.313875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:31.320316 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] Creating event network-vif-deleted:6553671d-60e7-4e61-bf1b-d839411b347c for instance 2057ebe0-ef52-42be-8192-758b1e62c589 on hv-cinder-85331 Sep 12 12:06:31.329054 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-1c3ebd30-414d-4fa5-859d-932a2a73e87f req-93969558-c112-45f5-a1d4-79afb0562cae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065461 Sep 12 12:06:31.337770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 695/1387] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:06:31.516988 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:31.517698 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:31.557944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:31.559926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:31.562778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:31.566160 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:31.567884 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:31.571313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:31.704291 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:31.713843 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-752de3f5-d854-47f6-bd49-bb96207abb04 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.445331 Sep 12 12:06:31.714465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 693/1388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:31 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:31.753512 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:31.771812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3713ee14-469b-4574-a10a-9cc60bd438dc tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 200 len: 1226 microversion: 2.1 time: 0.260192 Sep 12 12:06:31.780319 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 696/1389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:31 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 1226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:32.743024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:32.743739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:32.751101 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:32.751630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:32.752141 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:32.757036 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:32.757896 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:32.758681 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:32.809349 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:32.812418 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 2057ebe0-ef52-42be-8192-758b1e62c589] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:32.826006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:32.826839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:32.827688 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:32.828636 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:32.829318 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:32.830009 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:32.865253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] HTTP exception thrown: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Request method failure captured: Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 HTTP/1.1 Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx5RJHIuNoYoV7TOMZkTUmau9hPHd_llyLF_0xDTRbZ5oWSh5QOTESQGL-B9CnXr0iBLYxWG8VvvxFkOYCAuzn_CKLPWR7WJNQPMvodpO1Vchby4oAb6zapZiFhNoYKBcSPx6d1KBOJJaTvGtYeNgNbeAuD7Um16aImiaWIWZcRXngM Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:06:32.867761 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}] Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: fb4bb9cd41cd46ddb87a746e732a948f Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. Sep 12 12:06:32.869773 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '2057ebe0-ef52-42be-8192-758b1e62c589'} Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:06:32.870877 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. Sep 12 12:06:32.872629 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:32.874263 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Returning 404 to user: Instance 2057ebe0-ef52-42be-8192-758b1e62c589 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:06:32.874453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7baf070-03f1-47bb-b012-9dea11846903 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589" status: 404 len: 111 microversion: 2.1 time: 0.072847 Sep 12 12:06:32.876205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 697/1390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:32 2022] GET /compute/v2.1/servers/2057ebe0-ef52-42be-8192-758b1e62c589 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:06:33.118877 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:33.131837 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec747598-208b-4093-b39c-e3431ed30686 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.393049 Sep 12 12:06:33.143277 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 694/1391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:32 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:34.141570 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "name": "network-vif-plugged", "status": "completed", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:34.158604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:34.160536 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:34.170860 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:34.185862 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:34.189820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:34.190422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:34.191282 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:34.191968 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:34.193630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:34.194333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:34.195094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:34.228626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] Creating event network-vif-plugged:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:06:34.238125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e8155efa-0d47-4579-988b-1d9ac6d60da6 req-9ba76c3c-b4a6-4d48-9cdf-fad00b50d0e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100064 Sep 12 12:06:34.241075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 698/1392] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:06:34.476910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:34.487739 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff98bebf-046a-4c40-8ad7-846a2dac40e0 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.332642 Sep 12 12:06:34.490327 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:34 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:35.517974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:35.518770 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:35.530053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:35.530560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:35.533707 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:35.534711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:35.535356 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:35.535951 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:35.835633 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:35.844424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ca1495af-3b97-426f-801a-128ef34b4702 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.332325 Sep 12 12:06:35.855275 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 699/1394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:35 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:36.615993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:36.621003 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a129c6-8c47-41e9-b784-2f88285ab563", "tag": "a3a43907-0264-42ae-8f33-3cec8732e84c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:36.623244 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:36.636265 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.641517 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.642643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.645443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.645952 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.646412 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.648732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.649198 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.649649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.661498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] Creating event network-changed:a3a43907-0264-42ae-8f33-3cec8732e84c for instance 38a129c6-8c47-41e9-b784-2f88285ab563 on hv-cinder-85331 Sep 12 12:06:36.667474 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a65247f3-94ca-41b8-921e-7d60c38c207b req-31333c98-b5cb-4ac7-84d5-fda9afe8a624 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051564 Sep 12 12:06:36.669021 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 700/1395] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:06:36.707397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:06:36.837042 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67d25e25-2f38-43d7-869c-4e53e3fe6e48 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 204 len: 0 microversion: 2.1 time: 0.224446 Sep 12 12:06:36.837942 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 696/1396] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:06:36 2022] DELETE /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:06:36.847390 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:36.848620 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:36.858999 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.860102 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.860833 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.861788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.862703 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.863455 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.877687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:36.878928 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:36.886403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.887175 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.887794 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:36.889060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:36.890685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:36.891350 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:37.144542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:37.159475 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ded293c8-fc17-406c-9b9f-0099f92c3c25 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.285886 Sep 12 12:06:37.161546 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 697/1397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:36 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:37.165796 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:37.183669 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c4ac17e8-4de6-44c4-9848-165ead94fca6 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1577 microversion: 2.1 time: 0.332588 Sep 12 12:06:37.184529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 701/1398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:36 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1577 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:38.185066 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:38.186425 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:38.193444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:38.194079 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:38.195332 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:38.196444 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:38.196916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:38.197605 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:38.209164 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:38.210046 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:38.218253 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:38.218947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:38.219398 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:38.220110 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:38.220901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:38.223540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:38.374021 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:38.389756 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5b68444-b41c-4ea1-9b1b-50469b41a3f9 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.208405 Sep 12 12:06:38.393181 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 698/1399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:38 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:38.436130 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:38.447424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90da3dc1-3c5c-484b-8e0c-b3894888011c tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1577 microversion: 2.1 time: 0.242039 Sep 12 12:06:38.450501 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 702/1400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:38 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:39.419329 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:39.420624 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:39.428564 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:39.429733 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:39.430122 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:39.430973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:39.431590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:39.432174 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:39.474585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:39.476313 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:39.493437 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:39.494335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:39.495016 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:39.502279 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:39.503234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:39.505297 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:39.684254 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:39.693941 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e805895c-07ff-4633-9612-c15fd8cf488b tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1574 microversion: 2.1 time: 0.278353 Sep 12 12:06:39.695270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 699/1401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:39 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:39.724194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:39.744777 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bde43357-cd61-4fc7-92b2-241adf68fa34 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1577 microversion: 2.1 time: 0.274520 Sep 12 12:06:39.753376 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 703/1402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:39 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1577 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:40.718177 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:40.718901 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:40.733731 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:40.734654 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:40.735296 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:40.736187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:40.736682 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:40.737116 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:40.780743 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:40.787512 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:40.801037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:40.801524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:40.801960 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:40.802719 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:40.803172 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:40.803592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:40.928775 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:40.940509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47cdfeec-4190-49a5-9068-9aa9c06fe70e tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1561 microversion: 2.1 time: 0.226021 Sep 12 12:06:40.955668 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 700/1403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:40 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:40.963452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:40.971222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-65025a92-36e1-4371-a110-95d3bce6dfe0 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1577 microversion: 2.1 time: 0.194320 Sep 12 12:06:40.987045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 704/1404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:40 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:41.996257 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:41.997552 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:42.007709 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:42.008547 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:42.009153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:42.010013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:42.010651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:42.011250 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:42.602768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:42.606795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:42.612730 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-471082d7-32de-4751-9d04-0b47b63d0fd7 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1577 microversion: 2.1 time: 0.620028 Sep 12 12:06:42.623205 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 701/1405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:41 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1577 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:43.026226 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a129c6-8c47-41e9-b784-2f88285ab563", "name": "network-vif-deleted", "tag": "a3a43907-0264-42ae-8f33-3cec8732e84c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:43.036589 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:43.037067 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:43.037498 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:43.051982 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] Creating event network-vif-deleted:a3a43907-0264-42ae-8f33-3cec8732e84c for instance 38a129c6-8c47-41e9-b784-2f88285ab563 on hv-cinder-85331 Sep 12 12:06:43.057233 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-9597cee3-6b0e-442c-b8ae-f5ff39ad816d req-ffa3457d-9788-4f08-ae1c-b0e7aa60342c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038223 Sep 12 12:06:43.057829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 705/1406] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:06:43.641318 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:43.642763 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:43.654092 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:43.654910 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:43.655357 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:43.656061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:43.656517 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:43.656948 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:43.723300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:43.735315 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb29bc11-963e-4bbe-807a-029637eef9c2 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1510 microversion: 2.1 time: 0.097933 Sep 12 12:06:43.736197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 702/1407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:43 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:43.926885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1bc62864-f362-41c8-91e1-a21c164bbdd5 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'create', calling method: .version_select at 0x7fc93a6221f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-863374654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg8BeS5DH3WniGFwcTtWnky8tjJixvu/bTv0txW2KOI+0xhfFKf9W3UAN6WN1eGte1IHaH9rpI8YrXQXlHsMtLxNwy8jL7xTWJINSgQqxiWwhZpQqaGM0I8+Ul4nY096g=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:43.942315 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-1bc62864-f362-41c8-91e1-a21c164bbdd5 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Getting quotas for project b3df59bc28534911b091999aa03aca2e. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:06:43.946626 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-1bc62864-f362-41c8-91e1-a21c164bbdd5 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Getting quotas for user 12b69e54d58048b99559368c0cc9d7cf and project b3df59bc28534911b091999aa03aca2e. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:06:43.968732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1bc62864-f362-41c8-91e1-a21c164bbdd5 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046091 Sep 12 12:06:43.969331 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 706/1408] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 12 12:06:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:06:44.021867 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-637628946", "imageRef": "1f18edb6-c1dd-49e3-b57e-854c7c235c26", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-863374654", "networks": [{"uuid": "fc0a8ff3-7ed0-485c-be7a-be03928df4f9"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:44.073777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] validate_networks() for [('fc0a8ff3-7ed0-485c-be7a-be03928df4f9', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 12:06:44.511255 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 12:06:44.511687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 12:06:44.512166 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 12:06:44.512696 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 12:06:44.513114 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 12:06:44.524197 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:44.524853 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:44.525454 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:44.526251 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:44.526749 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:44.527183 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:44.545419 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Getting quotas for project b3df59bc28534911b091999aa03aca2e. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 12:06:44.549658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Getting quotas for user 12b69e54d58048b99559368c0cc9d7cf and project b3df59bc28534911b091999aa03aca2e. Resources: {'ram', 'cores', 'instances'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 12:06:44.564163 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 12:06:44.566502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f18edb6-c1dd-49e3-b57e-854c7c235c26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 12:06:44.616360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87f0dd0f-9001-4e38-a2a9-ad5b1842aa5d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598196 Sep 12 12:06:44.618010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 12 12:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 12:06:44.631201 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c3ddd7e-a25a-4000-869e-32951fef49bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:44.632186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c3ddd7e-a25a-4000-869e-32951fef49bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:44.691372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5c3ddd7e-a25a-4000-869e-32951fef49bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:44.700153 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c3ddd7e-a25a-4000-869e-32951fef49bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1257 microversion: 2.1 time: 0.074652 Sep 12 12:06:44.700683 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 707/1410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:44 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:44.761477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:44.762054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:44.768649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:44.769144 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:44.769590 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:44.770290 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:44.770806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:44.771214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:44.836248 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:44.844986 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51e38d6e-9140-4cc6-a7e0-ab4a73affa0a tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1391 microversion: 2.1 time: 0.088558 Sep 12 12:06:44.845925 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:44 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1391 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:45.723768 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:45.724401 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:45.731964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:45.732440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:45.732868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:45.733544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:45.733992 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:45.734472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:45.801452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:45.809485 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9ae18f71-8f78-44ce-83c8-e40dd16ea9ce tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1309 microversion: 2.1 time: 0.089515 Sep 12 12:06:45.810084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 708/1412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:45 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:45.870618 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:45.871832 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:45.878988 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:45.879757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:45.880422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:45.881479 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:45.883876 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:45.884415 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:45.930078 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:45.930734 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:45.931194 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:45.931768 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lazy-loading 'fault' on Instance uuid 38a129c6-8c47-41e9-b784-2f88285ab563 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:06:45.995323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4bb9cd41cd46ddb87a746e732a948f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d05fbbec08d43468068ce162f427eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:46.003270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b9619d2-688a-4c7b-abae-fa66a6074794 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 200 len: 1396 microversion: 2.1 time: 0.137318 Sep 12 12:06:46.003883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:45 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 1396 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:46.833387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:46.834371 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:46.843691 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:46.844757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:46.845544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:46.846834 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:46.848018 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:46.851438 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.026661 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:47.027916 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 38a129c6-8c47-41e9-b784-2f88285ab563] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:47.041515 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.042013 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.042458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.043178 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.046641 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.047380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.090932 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] HTTP exception thrown: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Request method failure captured: Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 HTTP/1.1 Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx5RJHIuNoYoV7TOMZkTUmau9hPHd_llyLF_0xDTRbZ5oWSh5QOTESQGL-B9CnXr0iBLYxWG8VvvxFkOYCAuzn_CKLPWR7WJNQPMvodpO1Vchby4oAb6zapZiFhNoYKBcSPx6d1KBOJJaTvGtYeNgNbeAuD7Um16aImiaWIWZcRXngM Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:06:47.092806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}] Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: fb4bb9cd41cd46ddb87a746e732a948f Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. Sep 12 12:06:47.094591 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '38a129c6-8c47-41e9-b784-2f88285ab563'} Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:06:47.095632 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. Sep 12 12:06:47.097294 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.099658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Returning 404 to user: Instance 38a129c6-8c47-41e9-b784-2f88285ab563 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:06:47.099658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-598770d9-5d63-4f5a-ba85-41d83959ddfd tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563" status: 404 len: 111 microversion: 2.1 time: 0.074199 Sep 12 12:06:47.099658 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 706/1414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:47 2022] GET /compute/v2.1/servers/38a129c6-8c47-41e9-b784-2f88285ab563 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 12:06:47.123814 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:47.133724 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-07aa09e8-3ad2-4646-9d89-cc4afebf6a19 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.304114 Sep 12 12:06:47.139660 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 709/1415] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:46 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:47.934105 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:47.934723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:47.941360 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.941926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.942502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.943306 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.943883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.944397 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.962206 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] HTTP exception thrown: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Request method failure captured: Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 HTTP/1.1 Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx5RJHIuNoYoV7TOMZkTUmau9hPHd_llyLF_0xDTRbZ5oWSh5QOTESQGL-B9CnXr0iBLYxWG8VvvxFkOYCAuzn_CKLPWR7WJNQPMvodpO1Vchby4oAb6zapZiFhNoYKBcSPx6d1KBOJJaTvGtYeNgNbeAuD7Um16aImiaWIWZcRXngM Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:06:47.963967 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}] Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: fb4bb9cd41cd46ddb87a746e732a948f Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:47.965931 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': '14981185-c481-469f-82d7-e05a3cc0ee87'} Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:06:47.967001 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:47.968816 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:06:47.970630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Returning 404 to user: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:06:47.970630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95103700-40b7-4470-b789-93dca06244fa tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "DELETE /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 404 len: 111 microversion: 2.1 time: 0.035802 Sep 12 12:06:47.970630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 707/1416] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:06:47 2022] DELETE /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:06:47.975283 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:47.975895 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] [instance: 14981185-c481-469f-82d7-e05a3cc0ee87] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:47.982581 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.983075 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.983734 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:47.984628 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:47.985089 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:47.985518 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:48.005974 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] HTTP exception thrown: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Request method failure captured: Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 HTTP/1.1 Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHx5RJHIuNoYoV7TOMZkTUmau9hPHd_llyLF_0xDTRbZ5oWSh5QOTESQGL-B9CnXr0iBLYxWG8VvvxFkOYCAuzn_CKLPWR7WJNQPMvodpO1Vchby4oAb6zapZiFhNoYKBcSPx6d1KBOJJaTvGtYeNgNbeAuD7Um16aImiaWIWZcRXngM Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:06:48.009061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d05fbbec08d43468068ce162f427eeb"}]}] Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6d05fbbec08d43468068ce162f427eeb Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestVolumeBootPattern-188456415 Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: fb4bb9cd41cd46ddb87a746e732a948f Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestVolumeBootPattern-188456415-project Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:48.010643 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': '14981185-c481-469f-82d7-e05a3cc0ee87'} Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:06:48.011687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. Sep 12 12:06:48.013440 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:06:48.015550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Returning 404 to user: Instance 14981185-c481-469f-82d7-e05a3cc0ee87 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:06:48.015550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-769da070-8858-4b06-8bf0-ac5de3623059 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87" status: 404 len: 111 microversion: 2.1 time: 0.039268 Sep 12 12:06:48.015550 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 710/1417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:47 2022] GET /compute/v2.1/servers/14981185-c481-469f-82d7-e05a3cc0ee87 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:06:48.167135 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:48.167740 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:48.174393 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:48.175142 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:48.175576 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:48.176273 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:48.176724 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:48.177150 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:48.324363 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:48.335074 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-204cb434-3b85-4878-bd80-77ef2c99aef7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.172408 Sep 12 12:06:48.336787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 708/1418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:48 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:49.325977 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fc6f0cc5-5817-40d9-98d6-c72d3dbc0727 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] Calling method '.version_select at 0x7fc93a5a6ca0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:49.361059 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:49.362689 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:49.370188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:49.370726 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:49.371169 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:49.371880 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:49.372523 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:49.373241 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:49.383006 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fc6f0cc5-5817-40d9-98d6-c72d3dbc0727 tempest-TestVolumeBootPattern-188456415 tempest-TestVolumeBootPattern-188456415-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2051257965" status: 202 len: 0 microversion: 2.1 time: 0.060653 Sep 12 12:06:49.383812 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 711/1419] 10.222.0.15 () {58 vars in 1263 bytes} [Mon Sep 12 12:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2051257965 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:06:49.568182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:49.576380 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1113fa7c-5df4-46df-a763-af2360e15ac7 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.219960 Sep 12 12:06:49.577264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 709/1420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:49 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:50.602038 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:50.602808 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:50.609836 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:50.610333 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:50.610788 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:50.611690 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:50.612138 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:50.612549 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:50.842234 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:50.850965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d606f1fb-5815-4864-ac57-51d9f4f14d1f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.254127 Sep 12 12:06:50.851602 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 712/1421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:50 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:51.903784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:51.903784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:51.903784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:51.903784 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:51.904993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:51.904993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:51.904993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:51.904993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:52.115157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:52.125161 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b8d4ceb-1c98-4252-87f8-5262d59ac29a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.255715 Sep 12 12:06:52.125725 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 710/1422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:51 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:53.149350 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:53.149955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:53.156495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:53.156925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:53.157357 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:53.158045 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:53.158497 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:53.158939 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:53.365978 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:53.376397 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8683aecc-ea4e-4eb9-92ac-11a676845b52 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.230962 Sep 12 12:06:53.377148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 713/1423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:53 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:54.398503 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:54.399195 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:54.405429 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:54.405912 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:54.406575 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:54.407461 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:54.408069 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:54.408700 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:54.535186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:54.557483 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:54.607182 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:54.616516 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13ee07af-fed7-400e-90c7-2cb2a6a0c694 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.221974 Sep 12 12:06:54.617221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 711/1424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:54 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:55.640037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:55.641321 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:55.644055 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:55.650883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:55.651786 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:55.652521 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:55.653483 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:55.654144 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:55.654965 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:55.855715 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:55.868759 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-56eda161-3562-4383-bd7e-e821f621a92d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.229025 Sep 12 12:06:55.869585 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 714/1425] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:55 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:56.892696 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:56.893317 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:56.895693 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:56.901456 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:56.901953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:56.902396 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:56.903137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:56.903600 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:56.904034 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:57.102973 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:57.110955 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60d039c1-1874-4989-84a5-aa5903da93c2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.222109 Sep 12 12:06:57.111532 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 712/1426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:56 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:06:58.135347 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:58.136048 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:58.138567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:58.144241 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:58.144806 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:58.145343 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:58.146117 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:58.146668 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:58.147157 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:58.151685 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:06:58.294535 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:58.302749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-33db5e7f-a8e5-4814-a5fc-bbec2c8faa93 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.171748 Sep 12 12:06:58.303342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 715/1427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:58 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:59.325427 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:06:59.326067 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:06:59.332432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:59.332914 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:59.333351 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:59.334044 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:59.334500 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:59.334953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:59.552077 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:06:59.560270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3fdc231d-c3d2-40f9-865c-76a98b928e4b tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.238929 Sep 12 12:06:59.560848 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 713/1428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:06:59 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:06:59.582471 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:06:59.595449 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:06:59.596043 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:06:59.596544 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:06:59.608568 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] Creating event network-changed:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:06:59.613969 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-3350e08a-78a0-49a2-9c56-3d5d3b7f502f req-2cf0fcf5-55a8-4d46-8180-fcdaa49489b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035657 Sep 12 12:06:59.614813 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 716/1429] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:07:00.583574 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:00.584224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:00.590621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:00.591103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:00.591539 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:00.592259 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:00.592712 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:00.593140 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:00.725481 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:00.735735 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c724c2f-159c-4ad6-bbc6-c5fe54125648 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.156056 Sep 12 12:07:00.736346 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 714/1430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:00 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:01.760326 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:01.761037 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:01.767868 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:01.768355 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:01.768795 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:01.769489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:01.770135 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:01.770590 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:01.914168 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:01.922334 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ef50bb80-4c43-4bcb-9448-87a190120dc6 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.166697 Sep 12 12:07:01.922923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 717/1431] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:01 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:02.944535 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:02.945153 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:02.952862 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:02.953630 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:02.954076 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:02.954821 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:02.955275 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:02.955711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:03.100995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:03.109422 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68d345ce-d922-4566-907d-7f91a8bf1217 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.168696 Sep 12 12:07:03.109996 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 715/1432] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:02 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:07:04.133885 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:04.134714 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:04.142579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:04.143317 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:04.143962 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:04.144702 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:04.145158 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:04.145600 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:04.300505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:04.312611 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-025da2eb-e227-468d-bbd3-8c54186d3a96 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.182554 Sep 12 12:07:04.313081 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 718/1433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:04 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:05.335884 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:05.336649 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:05.343265 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:05.343745 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:05.344186 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:05.344891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:05.345347 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:05.345793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:05.485157 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:05.494440 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77ceecc6-3b8f-4a74-8fb2-9663e1d0a53d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.162174 Sep 12 12:07:05.506793 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 716/1434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:05 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:05.625212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "name": "network-vif-plugged", "status": "completed", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:07:05.638088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:05.638855 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:05.639289 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:05.650372 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] Creating event network-vif-plugged:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:07:05.656727 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-97c45029-a461-4b48-bf61-140fbadf3bc4 req-705d2937-34f6-41f3-b9ff-c250f11521b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Sep 12 12:07:05.657625 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 719/1435] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:07:06.524964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:06.526218 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:06.532588 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:06.533070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:06.533550 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:06.534236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:06.534719 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:06.535149 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:06.666449 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:06.674080 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed65022e-4989-45e2-9d7f-0da82700ba49 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.153169 Sep 12 12:07:06.674685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 717/1436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:06 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:07.698820 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:07.700713 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:07.707085 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:07.707639 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:07.708141 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:07.708949 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:07.709462 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:07.709955 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:07.844513 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:07.852524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-753b6c01-61be-486a-a34e-8cee2b578b40 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1357 microversion: 2.1 time: 0.158746 Sep 12 12:07:07.853096 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 720/1437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:07 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:08.877048 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:08.877711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:08.886070 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:08.886651 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:08.887857 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:08.888811 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:08.889323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:08.889764 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.043887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:09.054598 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b8c5947-00a0-4dd0-af47-a9a75a468269 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1546 microversion: 2.1 time: 0.182071 Sep 12 12:07:09.066777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 718/1438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:08 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:09.085579 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:09.087991 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:09.097065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.097959 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.098776 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.099572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.100105 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.100632 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.267526 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:09.275211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aba162c4-f254-4f74-bcd6-39d0fc89a58c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1546 microversion: 2.1 time: 0.196642 Sep 12 12:07:09.275778 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 721/1439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:09 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:09.297400 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:09.302428 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:09.303233 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Searching by: {'deleted': False, 'project_id': 'b3df59bc28534911b091999aa03aca2e'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 12 12:07:09.310847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.311467 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.312038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.312789 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.313250 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.313820 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.406258 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 12 12:07:09.488721 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:07:09.505513 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11e040db-03b5-4da8-8ed3-8280c284f53f tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212438 Sep 12 12:07:09.506103 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 719/1440] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Sep 12 12:07:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:07:09.517883 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:09.518540 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:09.524504 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.524986 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.525421 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.526109 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:09.526592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:09.527019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:09.658148 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:09.665917 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-626aff20-d6fb-4e77-a332-99ea2fce5109 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1546 microversion: 2.1 time: 0.151918 Sep 12 12:07:09.666477 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 722/1441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:09 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:11.223842 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95f5b00c-40e7-4a45-ad45-25e70988ba98"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:07:11.226263 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:11.233173 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:11.233656 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:11.234094 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:11.234806 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:11.235264 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:11.235690 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:11.511010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-896b5595-4ee0-47c7-8243-6e77a0745166 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291265 Sep 12 12:07:11.511615 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 720/1442] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 12 12:07:11 2022] POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:07:19.116024 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:19.116638 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:19.123122 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:19.123592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:19.124028 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:19.124704 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:19.125149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:19.125564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:19.258031 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:19.267231 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b2440f8b-8068-4dc4-a5f4-09b10dcb42b4 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1592 microversion: 2.1 time: 0.154409 Sep 12 12:07:19.267804 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 723/1443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:19 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:07:21.029418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:07:21.034320 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:07:21.044943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:21.045783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:21.045913 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:21.059283 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] Creating event network-changed:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:07:21.065937 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c1860188-051b-447f-9ccb-76f545c14879 req-ceae0457-ea04-4180-aef8-d3af85e480d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037866 Sep 12 12:07:21.066960 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 721/1444] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:07:22.231078 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2108972676"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:07:22.232363 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:22.240756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:22.241280 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:22.241863 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:22.242596 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:22.243065 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:22.243489 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:22.378532 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.network.security_group_api [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Adding security group 2d59be2b-3467-4a6d-8c5d-482f99f7f9f1 to port 036f9a16-5989-4c50-b34d-15363a91534b Sep 12 12:07:22.687923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c00016d8-a9ca-4c2b-a5d8-e572f9965d68 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action" status: 202 len: 0 microversion: 2.1 time: 0.460974 Sep 12 12:07:22.688830 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 724/1445] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:07:22 2022] POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:07:22.696300 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:07:22.699351 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:07:22.699995 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:07:22.707119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:22.707609 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:22.707782 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:22.708044 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:22.708243 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:22.708757 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:22.708880 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:07:22.709328 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:07:22.709752 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:07:22.722737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] Creating event network-changed:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:07:22.728289 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-dd78a5c3-a6c4-4ec8-b058-1d980afae712 req-8894c207-ad34-4cec-830d-b5ee9dc133d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036039 Sep 12 12:07:22.729236 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 722/1446] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 12:07:22.894058 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:07:22.903074 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a8940a77-8cee-44c3-90fc-96ccc5780932 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1758 microversion: 2.1 time: 0.207324 Sep 12 12:07:22.904835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 725/1447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:07:22 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:18.189403 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=21 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:08:18.190891 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:08:18.195732 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:08:18.196237 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:18.196344 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:18.202101 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=21 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:08:18.202901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=55 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:08:18.205049 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:18.205580 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:18.206010 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:18.206888 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:18.207355 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:18.207807 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:18.211166 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:18.211651 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:18.213673 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:18.225229 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] Creating event network-changed:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:08:18.231282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-92f19c97-9b32-4c76-bbf4-c2e2cd80a0dc req-bb613bac-20c3-4d98-a53d-06a5ce7ed662 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Sep 12 12:08:18.232088 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 726/1448] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:08:18.235578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:08:18.321061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50642fd7-7f8f-4177-a55a-df9b6444ec19 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 204 len: 0 microversion: 2.1 time: 0.132919 Sep 12 12:08:18.321883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 723/1449] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:08:18 2022] DELETE /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 12:08:18.331206 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:18.331902 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:18.338119 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:18.338630 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:18.339062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:18.339750 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:18.340199 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:18.340618 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:18.597722 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:18.606207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae505715-3317-4ead-9a8d-e5424d7a0ddc tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.279798 Sep 12 12:08:18.606816 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 727/1450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:18 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:19.630995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:19.631694 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:19.637964 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:19.638443 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:19.638919 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:19.639606 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:19.640060 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:19.640483 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:19.820335 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:19.828723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90bcb749-f79c-46ac-88e2-e82b919d1fbf tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1567 microversion: 2.1 time: 0.201745 Sep 12 12:08:19.829268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 724/1451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:19 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:20.852956 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:20.854463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:20.861097 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:20.861577 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:20.862012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:20.862735 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:20.863185 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:20.863608 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:20.994753 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:21.002460 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0ecd44c0-f4e7-4496-b737-f8291e6292cd tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1448 microversion: 2.1 time: 0.153841 Sep 12 12:08:21.003240 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 728/1452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:20 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:21.170270 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db999bf5-0139-4955-a55e-c112a4c88ff5", "name": "network-vif-deleted", "tag": "04b9c451-0c54-4f4d-a349-7a2511078479"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:08:21.175953 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 12:08:21.176190 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Mon Sep 12 12:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.15) !!! Sep 12 12:08:21.183299 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:21.183783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:21.184221 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:21.195603 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] Creating event network-vif-deleted:04b9c451-0c54-4f4d-a349-7a2511078479 for instance db999bf5-0139-4955-a55e-c112a4c88ff5 on hv-cinder-85331 Sep 12 12:08:21.201395 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b90d2f8b-f964-4834-a53f-fee834e16dd6 req-3a6f84f1-cc2f-4c43-835a-e4f68f74250c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034803 Sep 12 12:08:21.201995 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 725/1453] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:08:22.025495 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:22.026084 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:22.032492 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:22.032961 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:22.033387 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:22.034062 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:22.034529 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:22.034947 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:22.067689 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:22.068165 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:22.068596 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:22.069029 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lazy-loading 'fault' on Instance uuid db999bf5-0139-4955-a55e-c112a4c88ff5 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:08:22.121921 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff513b1b924f54818d7d3e38eb4a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2862c2760b6548ae95e2ce59470ede1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:22.129910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-89546817-b289-4e92-99bc-735f4a321697 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 200 len: 1224 microversion: 2.1 time: 0.108411 Sep 12 12:08:22.130560 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 729/1454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:22 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:23.158298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:23.158950 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] [instance: db999bf5-0139-4955-a55e-c112a4c88ff5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:23.165065 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.165548 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.165984 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.166704 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.167933 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.168378 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.181287 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] HTTP exception thrown: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Request method failure captured: Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 HTTP/1.1 Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept: application/json Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Connection: close Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Length: 0 Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Content-Type: application/json Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Host: 10.222.0.15 Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjHx--8Vn5MBjPkiicspgGrfs4wGdtdifQeEp3MFxV1H9eWwuQiz6syAqI8z1yeQt0cNI43CNXJEY-94vMiWej1TPyOWah-gNFYPTEw5EECCelhoDllfUu89H4tSNANhtZRvqF_PPRv0S81uIGKthWT13ycoi_b9xHc-SSAfik7uDMU9U Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Id: 2862c2760b6548ae95e2ce59470ede1d Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-TestShelveInstance-616631131 Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Role: reader,member Sep 12 12:08:23.182965 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Roles: reader,member Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2862c2760b6548ae95e2ce59470ede1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2862c2760b6548ae95e2ce59470ede1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2862c2760b6548ae95e2ce59470ede1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2862c2760b6548ae95e2ce59470ede1d"}]}] Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-TestShelveInstance-616631131 Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 2862c2760b6548ae95e2ce59470ede1d Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestShelveInstance-616631131 Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User: tempest-TestShelveInstance-616631131-project Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Id: 72ff513b1b924f54818d7d3e38eb4a0b Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-TestShelveInstance-616631131-project Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: method: > Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: exception: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. Sep 12 12:08:23.184802 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: action_args: {'id': 'db999bf5-0139-4955-a55e-c112a4c88ff5'} Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:08:23.185881 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. Sep 12 12:08:23.187648 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Sep 12 12:08:23.189151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Returning 404 to user: Instance db999bf5-0139-4955-a55e-c112a4c88ff5 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:08:23.189151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-866f33a9-2a74-47d0-ae39-b25ddf2939b4 tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5" status: 404 len: 111 microversion: 2.1 time: 0.030768 Sep 12 12:08:23.189151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 726/1455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:23 2022] GET /compute/v2.1/servers/db999bf5-0139-4955-a55e-c112a4c88ff5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:08:23.342125 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7adc0b7-8bcd-4d4a-ae3d-e32a46c10cfe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] Calling method '.version_select at 0x7fc93a469f70>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:23.360373 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7adc0b7-8bcd-4d4a-ae3d-e32a46c10cfe tempest-TestShelveInstance-616631131 tempest-TestShelveInstance-616631131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208696406" status: 202 len: 0 microversion: 2.1 time: 0.022727 Sep 12 12:08:23.364232 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 730/1456] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Sep 12 12:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208696406 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:08:23.399753 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:08:23.402567 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:23.408571 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.409187 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.409628 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.410872 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.411331 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.411761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.499298 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-245e337e-c13f-4bac-9fee-9efaf5b56101 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action" status: 202 len: 0 microversion: 2.1 time: 0.103372 Sep 12 12:08:23.502883 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 727/1457] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:08:23 2022] POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:08:23.508212 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:23.509052 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:23.517060 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.517572 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.518194 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.518970 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:23.519472 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:23.520149 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:23.670726 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:23.679320 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3be9d1e2-b106-4303-8f49-7683ee061554 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1750 microversion: 2.1 time: 0.175103 Sep 12 12:08:23.680163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 731/1458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:23 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:08:24.705561 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:24.707621 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:24.713777 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:24.714790 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:24.715230 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:24.715943 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:24.716374 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:24.716795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:24.963836 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:24.973143 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fadf2319-02ac-4d86-8c19-16083918318e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.272575 Sep 12 12:08:24.973723 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 728/1459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:24 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:25.997523 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:25.998894 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:26.006261 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:26.007073 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:26.007756 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:26.008829 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:26.009500 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:26.010180 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:26.185576 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:26.193926 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c35bdfb5-109a-4bb2-af20-3d17ee9e9376 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.201188 Sep 12 12:08:26.194499 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 732/1460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:25 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 12:08:27.218484 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:27.219118 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:27.225418 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:27.225905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:27.226342 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:27.227063 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:27.227518 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:27.227945 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:27.375050 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:27.383146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35f07f02-ae40-441c-8aeb-50361828af81 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.169253 Sep 12 12:08:27.394761 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 729/1461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:27 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:28.408798 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:28.409478 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:28.416247 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:28.416729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:28.417205 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:28.418592 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:28.419079 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:28.419505 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:28.647764 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:28.656747 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-677644d3-b3d1-462e-8890-bb9ec2f4e578 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.251907 Sep 12 12:08:28.657446 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 733/1462] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:28 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:29.682711 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:29.683828 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:29.690297 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:29.690940 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:29.691376 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:29.692054 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:29.692502 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:29.692926 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:29.850614 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:29.862448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-915a392c-a480-4797-94f5-33d152688c64 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.183494 Sep 12 12:08:29.863061 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 730/1463] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:29 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:30.887008 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:30.887687 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:30.893423 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:30.893907 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:30.894342 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:30.895059 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:30.895514 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:30.895944 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:31.048186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:31.056622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e936f66a-0c44-4cd7-8b1f-bc3633a32b84 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.173949 Sep 12 12:08:31.057287 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 734/1464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:30 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:32.081604 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:32.082217 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:32.088509 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:32.088999 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:32.089465 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:32.090188 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:32.090685 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:32.091137 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:32.235278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:32.243366 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab48db0b-261e-42f5-8c9a-d2afb1de01d0 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.166011 Sep 12 12:08:32.243924 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 731/1465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:32 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:33.268219 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:33.268823 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:33.275447 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:33.275952 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:33.276385 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:33.277711 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:33.278177 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:33.278623 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:33.423296 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:33.431575 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5ad00553-c18a-464b-82a0-ecd47ad1834c tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.167231 Sep 12 12:08:33.432142 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 735/1466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:33 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:34.457164 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:34.457801 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:34.464732 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:34.465223 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:34.465688 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:34.466373 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:34.466851 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:34.467278 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:34.613386 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:34.622268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-daed2b05-be81-47dd-824b-a981edbea35e tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1755 microversion: 2.1 time: 0.169182 Sep 12 12:08:34.622795 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 732/1467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:34 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:08:35.645335 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:08:35.645946 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:08:35.652429 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:35.652901 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:35.653332 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:35.654012 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:08:35.654463 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:08:35.654910 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:08:35.804211 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:08:35.813186 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c9518e39-9621-4988-99fe-e458319b7b1a tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1758 microversion: 2.1 time: 0.171789 Sep 12 12:08:35.813757 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 736/1468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:08:35 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:09:31.278207 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2108972676"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:09:31.278878 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:31.281458 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:09:31.282224 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:09:31.289495 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:31.290000 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:31.290439 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:31.291151 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:31.291609 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:31.292024 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:31.423047 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Removing security group 2d59be2b-3467-4a6d-8c5d-482f99f7f9f1 from port 036f9a16-5989-4c50-b34d-15363a91534b Sep 12 12:09:31.725383 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31359d43-6214-4e14-bc1e-f1972df023a2 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action" status: 202 len: 0 microversion: 2.1 time: 0.451972 Sep 12 12:09:31.726130 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 733/1469] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 12 12:09:31 2022] POST /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:09:31.734659 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:09:31.741278 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:09:31.742108 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=58 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 12:09:31.746001 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:31.746476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:31.746940 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:31.761339 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] Creating event network-changed:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:09:31.766841 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-a31e7922-ce3d-4015-9f68-e56b53fe2549 req-497284a8-e378-4806-94e5-f2818a7a8d7b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035877 Sep 12 12:09:31.767452 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 737/1470] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:09:33.258434 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:09:33.259132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:33.259132 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:33.265737 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:33.266445 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:33.266905 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:33.267787 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:33.268477 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:33.268904 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:33.269055 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:33.269378 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:33.269803 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:33.281682 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] Creating event network-changed:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:09:33.286749 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-48d80b42-e6fa-44f3-9892-59abba518222 req-2e3738bf-3641-489a-afea-215a2ee1588d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032249 Sep 12 12:09:33.289784 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 738/1471] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:09:33.357779 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lazy-loading 'services' on Instance uuid d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 12:09:33.445780 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da2d42a4-1471-424c-81f3-d4ad76955002 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments/95f5b00c-40e7-4a45-ad45-25e70988ba98" status: 202 len: 0 microversion: 2.1 time: 0.193424 Sep 12 12:09:33.447022 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 734/1472] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:09:33 2022] DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments/95f5b00c-40e7-4a45-ad45-25e70988ba98 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 12:09:33.456641 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:33.460567 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:33.467430 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:33.468294 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:33.468912 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:33.469785 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:33.470454 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:33.471594 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:33.509954 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0abf84ad-7d47-49ea-896f-bf7ca94786aa tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057744 Sep 12 12:09:33.510564 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 739/1473] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:09:33 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:09:34.524810 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:34.526993 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:34.532976 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:34.533448 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:34.533875 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:34.534565 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:34.535014 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:34.535432 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:34.563492 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7807d8a-742d-4b2a-a6db-0ff3543a6d7d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044059 Sep 12 12:09:34.564038 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 735/1474] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 12 12:09:34 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 12:09:34.574464 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:34.575004 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:34.581282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:34.582019 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:34.582453 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:34.583163 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:34.583622 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:34.584050 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:34.661092 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] HTTP exception thrown: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c is not attached to volume 95f5b00c-40e7-4a45-ad45-25e70988ba98 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Request method failure captured: Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments/95f5b00c-40e7-4a45-ad45-25e70988ba98 HTTP/1.1 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHyDB_r3TGX9Us6L5vB-V6PtXgKw504XXjfe5TsHCTF9h5GXf1NDu7uNyPcVp53CPF03d3vJ9f-FKnm245DY53LTmCFKfZ8nBtHtAkzg84wX1G0mYlgM15ak9MLkvcwPdfdyR3llHgNa2Z3uXXFF97JvWKTlYVXlvrbvlzqLI3E7ObU0 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b3df59bc28534911b091999aa03aca2e Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:09:34.663697 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b3df59bc28534911b091999aa03aca2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b3df59bc28534911b091999aa03aca2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3df59bc28534911b091999aa03aca2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3df59bc28534911b091999aa03aca2e"}]}] Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b3df59bc28534911b091999aa03aca2e Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-TestMinimumBasicScenario-1610767783-project Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 12b69e54d58048b99559368c0cc9d7cf Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestMinimumBasicScenario-1610767783-project Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:09:34.665539 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c is not attached to volume 95f5b00c-40e7-4a45-ad45-25e70988ba98 Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'server_id': 'd076e9b6-c688-4e3e-9d15-dfb9fa0ad87c', 'id': '95f5b00c-40e7-4a45-ad45-25e70988ba98'} Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 95f5b00c-40e7-4a45-ad45-25e70988ba98. Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:09:34.666729 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c is not attached to volume 95f5b00c-40e7-4a45-ad45-25e70988ba98 Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c is not attached to volume 95f5b00c-40e7-4a45-ad45-25e70988ba98 Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:34.668417 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Returning 404 to user: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c is not attached to volume 95f5b00c-40e7-4a45-ad45-25e70988ba98 {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:09:34.669923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-09a554a1-65b1-4daa-a564-5a6f4a916233 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments/95f5b00c-40e7-4a45-ad45-25e70988ba98" status: 404 len: 154 microversion: 2.1 time: 0.094641 Sep 12 12:09:34.669923 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 740/1475] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 12 12:09:34 2022] DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c/os-volume_attachments/95f5b00c-40e7-4a45-ad45-25e70988ba98 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:09:35.803269 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:35.803774 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:35.810325 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:35.810847 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:35.811288 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:35.811980 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:35.812435 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:35.812863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:35.837887 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 12:09:35.908417 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8038615c-e815-4b21-8a00-867968b2bbdc tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 204 len: 0 microversion: 2.1 time: 0.109042 Sep 12 12:09:35.909193 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 736/1476] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 12 12:09:35 2022] DELETE /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 12:09:35.918383 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:35.919053 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:35.925377 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:35.925850 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:35.926282 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:35.926975 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:35.927424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:35.927842 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:36.056582 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:09:36.064284 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-23f42822-1d6c-4a04-b2b0-cf69a0741e71 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1552 microversion: 2.1 time: 0.149993 Sep 12 12:09:36.064835 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 741/1477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:09:35 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:09:37.087866 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:37.088578 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:37.094863 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:37.095340 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:37.095771 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:37.096453 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:37.096899 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:37.097323 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:37.227625 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:09:37.235214 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68d04b7c-4e86-484c-9a44-1d93327b915d tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1552 microversion: 2.1 time: 0.151525 Sep 12 12:09:37.235783 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 737/1478] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:09:37 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:09:38.259424 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:38.259981 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:38.266307 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:38.266828 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:38.267267 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:38.267958 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:38.268410 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:38.268839 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:38.401476 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12b69e54d58048b99559368c0cc9d7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3df59bc28534911b091999aa03aca2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 12:09:38.409207 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f67b232b-d85a-49f0-816b-a99c6025ad97 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 200 len: 1552 microversion: 2.1 time: 0.154125 Sep 12 12:09:38.409795 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 742/1479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:09:38 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 12:09:38.536869 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c", "name": "network-vif-deleted", "tag": "036f9a16-5989-4c50-b34d-15363a91534b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 12:09:38.547796 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:38.548268 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:38.548687 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:38.561542 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] Creating event network-vif-deleted:036f9a16-5989-4c50-b34d-15363a91534b for instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c on hv-cinder-85331 Sep 12 12:09:38.567146 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c473ade1-0351-4d93-add4-477383133298 req-55852086-b429-4013-8a7c-fa16dcb1a3f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033817 Sep 12 12:09:38.567767 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 738/1480] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 12 12:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 12:09:39.432616 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:39.433171 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] [instance: d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 12:09:39.439493 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:39.439964 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:39.440391 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:39.441061 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Acquiring lock "7eb38210-af3a-4045-a92c-aff35466c2af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 12:09:39.441524 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 12:09:39.441925 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Lock "7eb38210-af3a-4045-a92c-aff35466c2af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 12:09:39.454807 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] HTTP exception thrown: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Request method failure captured: Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c HTTP/1.1 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept: application/json Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Connection: close Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Length: 0 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Content-Type: application/json Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Host: 10.222.0.15 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjHyDB_r3TGX9Us6L5vB-V6PtXgKw504XXjfe5TsHCTF9h5GXf1NDu7uNyPcVp53CPF03d3vJ9f-FKnm245DY53LTmCFKfZ8nBtHtAkzg84wX1G0mYlgM15ak9MLkvcwPdfdyR3llHgNa2Z3uXXFF97JvWKTlYVXlvrbvlzqLI3E7ObU0 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Id: b3df59bc28534911b091999aa03aca2e Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Role: reader,member Sep 12 12:09:39.456304 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Roles: reader,member Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b3df59bc28534911b091999aa03aca2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b3df59bc28534911b091999aa03aca2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3df59bc28534911b091999aa03aca2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3df59bc28534911b091999aa03aca2e"}]}] Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Id: b3df59bc28534911b091999aa03aca2e Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1610767783 Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User: tempest-TestMinimumBasicScenario-1610767783-project Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Id: 12b69e54d58048b99559368c0cc9d7cf Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestMinimumBasicScenario-1610767783-project Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: method: > Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: exception: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. Sep 12 12:09:39.458327 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: action_args: {'id': 'd076e9b6-c688-4e3e-9d15-dfb9fa0ad87c'} Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 12:09:39.459395 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. Sep 12 12:09:39.461545 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Sep 12 12:09:39.463222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Returning 404 to user: Instance d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 12:09:39.463222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d4f59ef8-b51a-415b-b835-94fb46620a23 tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c" status: 404 len: 111 microversion: 2.1 time: 0.029843 Sep 12 12:09:39.463222 dv-cinder-853315-9-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 743/1481] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 12 12:09:39 2022] GET /compute/v2.1/servers/d076e9b6-c688-4e3e-9d15-dfb9fa0ad87c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 12:09:39.466959 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d892861-fd39-414c-bddb-4eccfe1321bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] Calling method '.version_select at 0x7fc93da92f70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 12:09:39.488922 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d892861-fd39-414c-bddb-4eccfe1321bd tempest-TestMinimumBasicScenario-1610767783 tempest-TestMinimumBasicScenario-1610767783-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-863374654" status: 202 len: 0 microversion: 2.1 time: 0.026016 Sep 12 12:09:39.489493 dv-cinder-853315-9-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 739/1482] 10.222.0.15 () {58 vars in 1269 bytes} [Mon Sep 12 12:09:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-863374654 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)